Python Weekly Product Scraper

I have a set of websites that publish product information I want captured on a regular basis. Your task is to build a clean Python scraper that collects the required fields and hands me back a neatly structured file every week.

Because this is strictly product information, the code should pull obvious details—name, price, SKU, availability, and any variant data that appears on the page. The sites use standard HTML with some lazy-loaded sections, so a mix of requests/BeautifulSoup and, where needed, Selenium or Playwright for the dynamic bits will work fine. I do not need images downloaded, only their URLs.

Here is what success looks like:
• A well-commented Python script (or Scrapy project) that runs headlessly and completes without manual intervention.
• Output delivered weekly as CSV or JSON; the script should timestamp the file so I can archive each run.
• Clear instructions on how to set up any virtual environment and schedule the job with cron or Windows Task Scheduler.
• Respectful scraping practices—proper headers, delays, and retry logic so the sites stay happy.

If you’ve built weekly product scrapers before, especially for e-commerce style layouts, that experience will help us hit the ground running.