Weekly Product Data Scraping

I need a reliable script that gathers product information from a set of websites and refreshes that data every week, without manual effort on my side. The data points I care about most are SKU, product title, current price, availability, description and image URLs. Some of the pages load content dynamically, so the solution may need a head-less browser approach (Selenium, Playwright, or similar) in addition to classic libraries such as Scrapy or BeautifulSoup.

The workflow I picture is straightforward: the crawler launches on a weekly schedule, pulls the latest product information, cleans and deduplicates the results, then exports everything to either CSV and/or JSON. A quick push to a Google Sheet or an S3 bucket afterward would be ideal so the file is immediately usable by the rest of my team.

Deliverables
• Well-commented source code (Python preferred)
• A simple scheduler set to run weekly (cron, Windows Task Scheduler, or self-contained)
• Sample output file showing at least one successful pull from each target site
• README with setup steps, selector notes and troubleshooting tips

For acceptance, I will run the script locally, confirm the data fields match the live site, and verify it can be triggered on the schedule without errors.