Scrape Car Form Dataset
Budget: $30 – $250 USD
I have a vehicle-search form on a public website and I need every possible outcome captured—Make, Model, Year, and Window type for each combination—then exported to a clean, well-structured CSV.
The form is dynamic, so the scraper must handle cascading dropdowns or any JavaScript that reveals further options. Rate-limiting and IP defenses are in place; please build your script to stay under the radar by smartly rotating proxies, varying user-agents, and pacing requests. Headless browsers such as Playwright or Puppeteer are fine if necessary, but I’m equally happy with a lean Python stack (Requests, Selenium, Scrapy, BeautifulSoup, Pandas) provided it finishes the job without getting blocked.
When you’re done I should be able to:
• Open one CSV file containing every unique Make / Model / Year / Window record with consistent column headers.
• See proof that the script can resume or rerun without duplicate entries or manual cleanup.
• Receive the executable code or notebook plus a short README explaining environment setup, the proxy pool logic, and how to trigger a full refresh.
If you have previous work that shows you can bypass rate limits gracefully, that will move you to the top of the list.
The form is dynamic, so the scraper must handle cascading dropdowns or any JavaScript that reveals further options. Rate-limiting and IP defenses are in place; please build your script to stay under the radar by smartly rotating proxies, varying user-agents, and pacing requests. Headless browsers such as Playwright or Puppeteer are fine if necessary, but I’m equally happy with a lean Python stack (Requests, Selenium, Scrapy, BeautifulSoup, Pandas) provided it finishes the job without getting blocked.
When you’re done I should be able to:
• Open one CSV file containing every unique Make / Model / Year / Window record with consistent column headers.
• See proof that the script can resume or rerun without duplicate entries or manual cleanup.
• Receive the executable code or notebook plus a short README explaining environment setup, the proxy pool logic, and how to trigger a full refresh.
If you have previous work that shows you can bypass rate limits gracefully, that will move you to the top of the list.
Related categories:
JavaScript
Python
Web Scraping
Software Architecture
Scrapy
BeautifulSoup
Selenium
Pandas