Python E-commerce Scraper for Oman Hypermarket

Job ID: 40430765

Budget: $250 – $750 USD

Overview:
I need an experienced Python developer to build a web scraper for a large e-commerce grocery and hypermarket website based in Oman. The site is a major regional retailer with a catalog of approximately 30,000 to 80,000 online product listings across multiple categories including grocery, electronics, fashion, pharmacy, and home goods.

What needs to be scraped:
For every product on the website, the script must extract:
- 3-level category hierarchy (L1, L2, L3)
- SKU or product ID
- Product name
- Price
- Product description
- Contents or ingredients (where available)

Technical requirements:
- Must use Playwright or Selenium as the site is JavaScript-rendered and cannot be scraped with basic HTTP requests
- Must include random delays between requests (2 to 5 seconds minimum) to avoid triggering rate limiting
- Must save output incrementally to an Excel file (.xlsx) so no data is lost if the script is interrupted
- Must include a checkpoint and resume system using a JSON file so the scraper can restart from where it left off
- Must have a clean CONFIG block at the top of the script for easy adjustment of settings (delay range, output filename, timeout values)
- Must handle pagination across all category pages

Deliverables:
1. A single well-commented Python script
2. A brief README explaining how to install dependencies and run the script
3. A sample output Excel file showing the correct column structure
4. One round of fixes if the website structure causes any extraction issues after delivery

Skills required:
Python, Playwright or Selenium, web scraping, data extraction, openpyxl, handling JavaScript-heavy websites

Budget guidance: Open to proposals. Please include your estimated timeline and how you plan to handle bot detection.

Note to bidders: Please share examples of previous e-commerce scraping projects you have completed, particularly for large catalogs with JavaScript rendering.