Government Public Records Scraper
Budget: ₹1,500 – ₹12,500 INR
I need to capture educational-related public records that are currently published only through an interactive government dashboard. The site renders its tables and charts on the client side, so a headless approach with Python plus Selenium, Playwright, or an equivalent tool will probably be required.
The job is straightforward: automate navigation through every filter, paginate until the end, collect each record exactly as displayed, and export the full dataset to CSV (JSON as a secondary file would be helpful). Please structure the code so I can rerun it when new data appears; a short README explaining any environment variables, libraries, and a quick-start command is all the documentation I need.
Accuracy matters more than speed, and the scraper must leave the dashboard’s settings untouched for other users. If you can add a simple retry/resume mechanism, that will seal the deal.
The job is straightforward: automate navigation through every filter, paginate until the end, collect each record exactly as displayed, and export the full dataset to CSV (JSON as a secondary file would be helpful). Please structure the code so I can rerun it when new data appears; a short README explaining any environment variables, libraries, and a quick-start command is all the documentation I need.
Accuracy matters more than speed, and the scraper must leave the dashboard’s settings untouched for other users. If you can add a simple retry/resume mechanism, that will seal the deal.
Related categories:
PHP
JavaScript
Python
Data Processing
Software Architecture
Data Extraction
Selenium
Automation