Automated Daily Price Tracker for E-Commerce Site (Python Script + Excel Output)
Budget: $30 – $250 USD
I’m looking for a dependable automation script that can scrape product data—including names, prices, SKUs, and stock availability—from a specific e-commerce website on a daily schedule (every 24 hours). The script should automatically compile all results into a neatly formatted Excel sheet, appending the crawl timestamp for each entry.
The scraper should be fully unattended, capable of navigating pagination, and designed to withstand basic anti-scraping defenses (rotating user-agents, retries, small randomized delays).
You can use any modern and efficient approach—Python (Requests + BeautifulSoup, Scrapy, or Playwright) preferred—so long as you provide:
- A complete, runnable script with simple setup instructions
- A sample Excel output file demonstrating all expected columns
- Short documentation explaining how to modify crawl frequency or update target URLs if the site structure changes
The final solution will be deployed on a Linux server using cron for scheduling, so please keep directory paths and runtime configuration compatible.
If you have questions about the target site or data format, I’ll respond promptly to keep things moving.
The scraper should be fully unattended, capable of navigating pagination, and designed to withstand basic anti-scraping defenses (rotating user-agents, retries, small randomized delays).
You can use any modern and efficient approach—Python (Requests + BeautifulSoup, Scrapy, or Playwright) preferred—so long as you provide:
- A complete, runnable script with simple setup instructions
- A sample Excel output file demonstrating all expected columns
- Short documentation explaining how to modify crawl frequency or update target URLs if the site structure changes
The final solution will be deployed on a Linux server using cron for scheduling, so please keep directory paths and runtime configuration compatible.
If you have questions about the target site or data format, I’ll respond promptly to keep things moving.
Related categories:
Python
Excel
Web Scraping
Software Architecture
Data Mining
Scrapy
Data Scraping
Data Extraction
BeautifulSoup
Automation