Python Product Data Scraper

I want a clean, well-commented Python 3 script that I can run locally whenever I need fresh information. The program should visit the target site (I’ll share the URL once we start) and pull Product Details exactly as they appear online. That means every time I point the script at a category or search page it should work through all pagination, capture the data, and save it to CSV or Excel so I can sort and analyse it later.

Key points to cover
• Use reliable, open-source libraries such as requests, BeautifulSoup, or Selenium—whichever gives the most stable results for the site once you see it.
• Build in simple settings (URL, output file name, optional delay between requests) near the top of the file so I can tweak them without touching the core logic.
• Handle common edge cases: missing fields, changing layouts, or temporary time-outs, and log any skipped items for review.
• Write clear inline comments and a short README so I can install requirements with one command and run the script from the terminal.

Deliverables
- Fully functional .py file pulling the specified Product Details
- requirements.txt listing every external package
- README with step-by-step setup and usage instructions

I’ll test the scraper against a few sample pages; if the exported file contains accurate Product Details for each item and the script runs without errors, we’re done.