Stabilize Amazon Job Scraper
Budget: $750 – $1,500 USD
I already have a working scraper that targets hiring.amazon.ca, but it quickly runs into 403 and 429 responses thrown by AWS WAF. My goal is simple: continue gathering job listings at full speed without resorting to artificial delays between requests.
What I need from you
• Diagnose exactly why the WAF is flagging my traffic (headers, cookies, TLS fingerprints, request rate, etc.)
• Implement whatever counter-measures are required—smart rotation of IPs or user-agents, better session handling, signed cookies, custom TLS fingerprints, residential proxies, captchas, or any technique you know that keeps requests fast and invisible.
• Hand back a clean, reproducible solution (preferably in Python, but I am flexible) that lets the scraper pull listings continuously with zero 403/429 interruptions.
Acceptance criteria
1. A script or module I can plug into my current scraper.
2. Demonstrable run (screen capture or log) showing at least 1 000 uninterrupted requests hitting hiring.amazon.ca endpoints with no delay logic and no WAF blocks.
3. Brief setup notes so I can replicate the environment on my side.
If you have real-world experience taming AWS WAF or similar edge firewalls, let’s get this running smoothly.
What I need from you
• Diagnose exactly why the WAF is flagging my traffic (headers, cookies, TLS fingerprints, request rate, etc.)
• Implement whatever counter-measures are required—smart rotation of IPs or user-agents, better session handling, signed cookies, custom TLS fingerprints, residential proxies, captchas, or any technique you know that keeps requests fast and invisible.
• Hand back a clean, reproducible solution (preferably in Python, but I am flexible) that lets the scraper pull listings continuously with zero 403/429 interruptions.
Acceptance criteria
1. A script or module I can plug into my current scraper.
2. Demonstrable run (screen capture or log) showing at least 1 000 uninterrupted requests hitting hiring.amazon.ca endpoints with no delay logic and no WAF blocks.
3. Brief setup notes so I can replicate the environment on my side.
If you have real-world experience taming AWS WAF or similar edge firewalls, let’s get this running smoothly.