Amazon Scraper with Proxy & Docker
Budget: $10 – $30 USD
I need a reliable, well-structured scraper for Amazon that runs inside Docker and routes every request through a rotating proxy API to keep the operation stable and undetected. The code must be written in Python and ultimately push each record straight into a database table rather than flat files; we can agree on the engine (SQLite) during kickoff.
Here is what I expect:
• A clean, modular Python codebase that can be rebuilt end-to-end with one docker-compose up.
• Proxy API integration already wired for retries, back-off logic, and session handling.
• Environment variables for keys, endpoints, and database credentials so nothing sensitive lives in the repo.
• A simple script or SQL file that creates the required table(s) and demonstrates that records are being inserted correctly.
• Brief README covering local setup, container commands, and how to extend or adjust the scraping targets.
I will provide the exact set of Amazon pages and the database schema once we start; for now, assume typical product information and be sure your approach remains adaptable. If you have existing middleware, captcha-handling tactics, or experience with Amazon’s anti-bot measures, please mention it in your bid.
Here is what I expect:
• A clean, modular Python codebase that can be rebuilt end-to-end with one docker-compose up.
• Proxy API integration already wired for retries, back-off logic, and session handling.
• Environment variables for keys, endpoints, and database credentials so nothing sensitive lives in the repo.
• A simple script or SQL file that creates the required table(s) and demonstrates that records are being inserted correctly.
• Brief README covering local setup, container commands, and how to extend or adjust the scraping targets.
I will provide the exact set of Amazon pages and the database schema once we start; for now, assume typical product information and be sure your approach remains adaptable. If you have existing middleware, captcha-handling tactics, or experience with Amazon’s anti-bot measures, please mention it in your bid.