Web Scraper Capability Upgrade
Budget: $250 – $750 USD
I already have a functioning Python-based scraper on a Raspberry PI that targets a small set of information from a website, but I now need it to do more. The immediate priority is to extend its reach so it can reliably pull more information from a specific site to be used in a bot.
The scraper currently pulls overtime information released at specific times and allows me to select an ID number for assignment. I want to upgrade it to handle multiple selections simultaneously. Additionally, I need the bot to rank weekend overtime assignments (assigned via lottery) and monitor for dropped assignments in real-time, automatically claiming them based on preferences.
While we are inside the code, I would also like to broaden what the bot can do once the data is captured.
It is already linked to a Twilio account to receive the current information pulled by the scraper.
Deliverables
• Refactored, well-documented codebase
• Two new site adapters that demonstrate the scalable scraping pattern
• Working module that collects and stores contact details
• Real-time monitoring and assignment functionality for dropped overtime
• README showing how to add more functions and run the scraper
• Optional but welcome: automated report/export script
Let me know about similar projects you have upgraded, the stack you prefer, and your expected timeline so we can get started right away.
The scraper currently pulls overtime information released at specific times and allows me to select an ID number for assignment. I want to upgrade it to handle multiple selections simultaneously. Additionally, I need the bot to rank weekend overtime assignments (assigned via lottery) and monitor for dropped assignments in real-time, automatically claiming them based on preferences.
While we are inside the code, I would also like to broaden what the bot can do once the data is captured.
It is already linked to a Twilio account to receive the current information pulled by the scraper.
Deliverables
• Refactored, well-documented codebase
• Two new site adapters that demonstrate the scalable scraping pattern
• Working module that collects and stores contact details
• Real-time monitoring and assignment functionality for dropped overtime
• README showing how to add more functions and run the scraper
• Optional but welcome: automated report/export script
Let me know about similar projects you have upgraded, the stack you prefer, and your expected timeline so we can get started right away.