Web Scraping Developer

Job ID: 40274005

Budget: $15 – $25 USD

We are looking for an experienced Web Scraping Developer to design, build, and maintain reliable, production-grade scraping systems.

Responsibilities:

Build scalable web scrapers and data extraction pipelines

Handle authentication (sessions, cookies, tokens)

Manage rate limits, retries, and anti-bot protections

Ensure zero data loss and high data integrity

Design monitoring, logging, and alerting mechanisms

Work with structured storage (SQL / JSONB)

Requirements:

Strong experience with Python

Solid understanding of HTTP, APIs, and browser behavior

Experience with tools like Playwright, Puppeteer, or Selenium

Knowledge of proxy management and anti-detection strategies

Database experience (PostgreSQL preferred)

Ability to design deterministic, fault-tolerant workflows

Nice to Have:

Experience with large-scale scraping architectures

Background in system design and performance optimization

Familiarity with DevTools protocol and HAR analysis

If you are detail-oriented, think in edge cases, and build systems that never miss data — we want to hear from you.