Automated Manufacturer Price Scraper
Budget: ₹12,500 – ₹37,500 INR
I need a reliable script that routinely visits a shortlist of manufacturer websites and captures up-to-date pricing for our catalogue of SKUs. The focus is strictly on pricing details; other product attributes can be ignored for now.
The scraper should:
• Navigate each manufacturer site, handle pagination or simple JavaScript if present, and pull the current price for every specified item.
• Export the data in a clean, structured format (CSV or JSON is fine) so it can slot straight into our internal dashboard.
• Be fully automated—think cron-friendly—with clear logging and straightforward error handling so I can spot and fix broken selectors quickly.
I work comfortably with Python, so please build with Scrapy, Requests/BeautifulSoup, Playwright, or a comparable stack that runs headlessly on Linux. Commented code and a short README explaining setup, configuration of target URLs/SKUs, and scheduling instructions will complete the job.
Accuracy and repeatability are the key acceptance criteria: one click (or cron) should give me a fresh, correct price file every time.
The scraper should:
• Navigate each manufacturer site, handle pagination or simple JavaScript if present, and pull the current price for every specified item.
• Export the data in a clean, structured format (CSV or JSON is fine) so it can slot straight into our internal dashboard.
• Be fully automated—think cron-friendly—with clear logging and straightforward error handling so I can spot and fix broken selectors quickly.
I work comfortably with Python, so please build with Scrapy, Requests/BeautifulSoup, Playwright, or a comparable stack that runs headlessly on Linux. Commented code and a short README explaining setup, configuration of target URLs/SKUs, and scheduling instructions will complete the job.
Accuracy and repeatability are the key acceptance criteria: one click (or cron) should give me a fresh, correct price file every time.
Related categories:
JavaScript
Python
Linux
Web Scraping
Scrapy
Data Extraction
BeautifulSoup
Automation