Daily Website Text Scraper CSV | CloudeFlare | Special domain
Budget: $30 – $250 USD
I need a reliable script that pulls specific text content from a particular website each day and appends the results to a clean, well-structured CSV. The crawl has to run automatically on a 24-hour schedule, capture only the text I specify, and overwrite or update the file so I can download it at any time.
Please handle the full workflow—from parsing the HTML through a stable method (Python with Requests + BeautifulSoup, Scrapy, or a comparable stack) to setting up the daily trigger (cron job, cloud function, or Windows Task Scheduler). The script must cope gracefully with minor layout changes and alert me if anything breaks.
Deliverables
• Fully commented source code
• One sample CSV generated from a test run
• Setup notes so I can deploy the job on my own server
Acceptance criteria
• Daily run executes without manual intervention
• CSV contains only the requested text fields, no duplicates, no missing rows
• Script finishes within reasonable time and logs basic success/error information
If you have questions about site structure or access, let me know and I’ll provide details promptly.
Please handle the full workflow—from parsing the HTML through a stable method (Python with Requests + BeautifulSoup, Scrapy, or a comparable stack) to setting up the daily trigger (cron job, cloud function, or Windows Task Scheduler). The script must cope gracefully with minor layout changes and alert me if anything breaks.
Deliverables
• Fully commented source code
• One sample CSV generated from a test run
• Setup notes so I can deploy the job on my own server
Acceptance criteria
• Daily run executes without manual intervention
• CSV contains only the requested text fields, no duplicates, no missing rows
• Script finishes within reasonable time and logs basic success/error information
If you have questions about site structure or access, let me know and I’ll provide details promptly.
Related categories:
PHP
JavaScript
Python
Data Processing
Web Scraping
Scrapy
BeautifulSoup
Automation