Senior Python Developer – Web Scraping Specialist (Realtor.com)

Job ID: 39360047

Budget: $30 – $250 USD

Before applying as this is a trial job means this is just for seeing if you're good fit for higher priced projects and etc. This one you'll be just upgrading and fixing the current scraper we have so would be simple and easy.

We're looking for a highly experienced Python scraper developer to rebuild and future-proof our current scraping system that pulls leads from Realtor.com. The current setup is buggy, inconsistent, and no longer reliably scraping. We need a 2.0 version that’s bulletproof, scalable, and can easily scrape 3,000–5,000+ real estate agent leads per day without IP bans or breakages.

Your Role:
Rebuild or significantly upgrade our current Python scraper

Maintain consistent scraping of Realtor.com agent leads (phone numbers, emails, office info, etc.)

Integrate smart IP rotation / proxy management

Build in error handling, retry logic, and scraper health checks

Structure the data cleanly for export (CSV/Google Sheets/API/DB)

Implement throttling and anti-blocking measures

Ensure scalability: minimum 3K–5K leads/day scrape capability

Our Requirements:
Expert-level Python web scraping skills

Deep experience with anti-bot bypassing, headers, rotating proxies, etc.

Prior experience scraping Realtor.com or similar real estate platforms is strongly preferred

Ability to reverse engineer site structures and adapt to changes fast

Familiarity with tools like Scrapy, Selenium, Playwright, Puppeteer, or custom headless setups

Must write clean, modular code that’s easy to maintain and scale

English fluency and regular communication

Nice to Have:
Experience with Captcha solving APIs (2Captcha, CapMonster, etc.)

Cloud deployment or serverless scaling knowledge (AWS Lambda, GCP, etc.)

Long-term vision: we want to build and maintain this together
Related categories: PHP Python Web Scraping CRM Outreach.io