Python Scraper Needed – Build Data Ingestion System from Public Vault Platforms
Budget: $25 – $50 USD
We're looking for a skilled Python developer to help us build a modular, automated scraping system that collects structured data from public-facing crypto vault and strategy platforms.
This is part of a long-term internal analytics and trading toolset. Your first task will focus on building scrapers that extract structured vault data across multiple live platforms.
What You’ll Build:
You’ll develop reusable Python scraper modules that:
Extract vault-level data from live platforms such as:
• Valio.xyz
• Hyperliquid.xyz
• Enzyme.finance
• Sommelier.finance
• Dhedge.org
• And others added over time
Collect and parse data such as:
Vault name or ID
PnL, Sharpe ratio, drawdown
Portfolio composition (assets + weights)
Vault creator (wallet or ENS)
Rebalancing patterns or trade activity (if accessible)
Output data in clean JSON format (initially), with future plans for PostgreSQL integration
Run automatically on a schedule using APScheduler, cron, or similar
Be built modularly so new platforms can be added easily
Tools We Expect You to Use:
Python
Playwright or Selenium (for JavaScript/dynamic websites)
Requests / BeautifulSoup (for simpler HTML pages)
JSON (structured output)
Bonus: web3.py or blockchain event scraping (for smart contract–based platforms like Enzyme)
What We're Looking For:
Experience scraping dynamic websites or trading/finance dashboards
Clean, reliable Python code with strong structure and logging
Ability to handle authentication, rate limits, timeouts, and retries
Bonus if you understand crypto vaults, DeFi platforms, or web3 data models
Project Scope:
Initial estimate: ~40–60 hours total
Timeline: 2–3 weeks from kickoff
Hourly rate: $30–60/hr based on experience
Ongoing work may follow for new integrations or scraper maintenance
To Apply, Please Answer:
Have you scraped any financial, trading, or DeFi data before? Share a quick example.
How would you approach scraping a dynamic dashboard like Valio or Sommelier?
Do you have experience with blockchain data (smart contracts, events, or web3.py)? Not required, but helpful.
This is part of a long-term internal analytics and trading toolset. Your first task will focus on building scrapers that extract structured vault data across multiple live platforms.
What You’ll Build:
You’ll develop reusable Python scraper modules that:
Extract vault-level data from live platforms such as:
• Valio.xyz
• Hyperliquid.xyz
• Enzyme.finance
• Sommelier.finance
• Dhedge.org
• And others added over time
Collect and parse data such as:
Vault name or ID
PnL, Sharpe ratio, drawdown
Portfolio composition (assets + weights)
Vault creator (wallet or ENS)
Rebalancing patterns or trade activity (if accessible)
Output data in clean JSON format (initially), with future plans for PostgreSQL integration
Run automatically on a schedule using APScheduler, cron, or similar
Be built modularly so new platforms can be added easily
Tools We Expect You to Use:
Python
Playwright or Selenium (for JavaScript/dynamic websites)
Requests / BeautifulSoup (for simpler HTML pages)
JSON (structured output)
Bonus: web3.py or blockchain event scraping (for smart contract–based platforms like Enzyme)
What We're Looking For:
Experience scraping dynamic websites or trading/finance dashboards
Clean, reliable Python code with strong structure and logging
Ability to handle authentication, rate limits, timeouts, and retries
Bonus if you understand crypto vaults, DeFi platforms, or web3 data models
Project Scope:
Initial estimate: ~40–60 hours total
Timeline: 2–3 weeks from kickoff
Hourly rate: $30–60/hr based on experience
Ongoing work may follow for new integrations or scraper maintenance
To Apply, Please Answer:
Have you scraped any financial, trading, or DeFi data before? Share a quick example.
How would you approach scraping a dynamic dashboard like Valio or Sommelier?
Do you have experience with blockchain data (smart contracts, events, or web3.py)? Not required, but helpful.
Related categories:
Python
Web Scraping
Software Architecture
Data Mining
PostgreSQL
JSON
Scrapy
Data Extraction
BeautifulSoup
Selenium