E-Commerce Product Scraper
Budget: ₹12,500 – ₹37,500 INR
I need a robust web-scraping solution that automatically collects product information from several e-commerce websites. The focus is on two key data points:
• Product name and full description
• Customer reviews and ratings
Price and availability are not required this time, so the crawler can ignore any endpoints related to stock or cost.
Please build the script so I can run it on demand and easily point it at new store URLs in the future. Python with BeautifulSoup, Scrapy, or a similar framework suits me fine, as long as the code is clean, well-commented, and leverages polite scraping practices (respectful delays, user-agent rotation, handling captchas when possible).
Deliverables:
1. Working scraper code with clear setup instructions
2. Sample CSV or JSON export containing the requested fields
3. Short README explaining how to tweak the target domains and data selectors
I will test by running the script against two live e-commerce sites and verifying that the exported file matches the page content for a random sample of products.
• Product name and full description
• Customer reviews and ratings
Price and availability are not required this time, so the crawler can ignore any endpoints related to stock or cost.
Please build the script so I can run it on demand and easily point it at new store URLs in the future. Python with BeautifulSoup, Scrapy, or a similar framework suits me fine, as long as the code is clean, well-commented, and leverages polite scraping practices (respectful delays, user-agent rotation, handling captchas when possible).
Deliverables:
1. Working scraper code with clear setup instructions
2. Sample CSV or JSON export containing the requested fields
3. Short README explaining how to tweak the target domains and data selectors
I will test by running the script against two live e-commerce sites and verifying that the exported file matches the page content for a random sample of products.
Related categories:
PHP
Python
Data Processing
Web Scraping
Software Architecture
Scrapy
Data Extraction
BeautifulSoup