Price Scraper for Wholesalers
Budget: £20 – £250 GBP
I need a reliable way to pull live price information from a set of wholesale supplier websites that sell a tiny number of specific products.
Here is what I expect:
• A script or small tool (Python with requests / BeautifulSoup, Scrapy or a comparable solution is fine) that visits each wholesale vendor page, captures the raw price shown for every listed product size or weight, and stores the result with a timestamp.
• A clean, machine-readable output (CSV or JSON) containing at minimum: vendor name, metal type, product variant, price, currency and capture time.
• Clear instructions so I can run the scraper myself whenever I need fresh data—no hard-coded paths or credentials, please.
If a site blocks automated traffic, note it and suggest a workaround; do not violate their terms. A short sample run demonstrating the concept is enough for acceptance, as long as the code can be extended to additional vendors later.
Here is what I expect:
• A script or small tool (Python with requests / BeautifulSoup, Scrapy or a comparable solution is fine) that visits each wholesale vendor page, captures the raw price shown for every listed product size or weight, and stores the result with a timestamp.
• A clean, machine-readable output (CSV or JSON) containing at minimum: vendor name, metal type, product variant, price, currency and capture time.
• Clear instructions so I can run the scraper myself whenever I need fresh data—no hard-coded paths or credentials, please.
If a site blocks automated traffic, note it and suggest a workaround; do not violate their terms. A short sample run demonstrating the concept is enough for acceptance, as long as the code can be extended to additional vendors later.
Related categories:
PHP
Python
Data Processing
Web Scraping
Software Architecture
Scrapy
Data Extraction
BeautifulSoup