Advanced Web Scraping Engineer Required

Job ID: 40076648

Budget: $30 – $250 USD

Project Description: We need an experienced web scraping engineer to build a reliable data extraction system from modern, protected websites. Target sites use advanced anti-bot protections (Cloudflare, Akamai) and JavaScript-rendered content, so this role is not suitable for basic scrapers.

Goals:
Scrape structured data from protected business listing websites
Normalize and export data for automation workflows
Build a stable, maintainable, production-ready scraper

Responsibilities:
Scrape data from JavaScript-heavy sites
Ethically bypass bot-detection systems
Handle pagination, infinite scroll, dynamic loading
Implement human-like behavior (delays, scrolling, session handling)
Extract structured fields (title, price, location, description, contact info)
Add logging, retries, error handling
Deliver clean, well-documented code

Required Skills:
Playwright or Puppeteer expertise
Proven experience with Cloudflare/Akamai
Anti-bot detection knowledge
Headless/headful browsers, user-agent rotation, session/cookie handling
Python
Clean, modular scraper design'

Nice to Have:
Proxy services (residential/rotating IPs)
Google Sheets/API integrations
Automation tools (n8n, Zapier, Make)
VPS deployment

Expectations:
Working prototype before full build
Clear explanation of approach
Honest discussion of limitations/maintenance
Professional communication & fast feedback cycles

To Apply:
Share your experience with Cloudflare/Akamai
Tools you’d use and why
Example projects/code (if possible)
Estimated timeline for prototype
please write "Akamai" in head of your proposal