Automated Website Data Scraper
Budget: £750 – £1,500 GBP
I need a reliable, repeatable solution that pulls specific data from one or more websites and delivers it in a clean, structured format—fast. Manual copying is not an option; I’m looking for an automated scraping workflow.
Scope
• Build or configure a scraper (Python + Scrapy, Selenium, BeautifulSoup, or a comparable stack) that can handle dynamic pages, pagination, and basic anti-bot measures.
• Extract the fields I specify and output them to CSV or JSON.
• Include a simple scheduler or command-line trigger so I can run the job on demand.
• Add basic validation and logging so I know when a scrape succeeded or failed.
Deliverables
1. Fully commented source code.
2. Sample dataset demonstrating the extractor works end-to-end.
3. Quick-start guide covering setup, configuration, and how to extend the scraper to new URLs later.
Timeline
I need a working first pass ASAP, with refinements immediately after initial review.
If you’ve built production-grade scrapers before and can turn around a solid prototype quickly, let’s get started.
Scope
• Build or configure a scraper (Python + Scrapy, Selenium, BeautifulSoup, or a comparable stack) that can handle dynamic pages, pagination, and basic anti-bot measures.
• Extract the fields I specify and output them to CSV or JSON.
• Include a simple scheduler or command-line trigger so I can run the job on demand.
• Add basic validation and logging so I know when a scrape succeeded or failed.
Deliverables
1. Fully commented source code.
2. Sample dataset demonstrating the extractor works end-to-end.
3. Quick-start guide covering setup, configuration, and how to extend the scraper to new URLs later.
Timeline
I need a working first pass ASAP, with refinements immediately after initial review.
If you’ve built production-grade scrapers before and can turn around a solid prototype quickly, let’s get started.
Related categories:
JavaScript
Python
Web Scraping
Software Architecture
Scrapy
Data Extraction
BeautifulSoup
Selenium