Python Web Scraping - looking for long-term preferred partner
Budget: £20 – £250 GBP
I'm in need of a Python expert who can scrape product details and prices from various e-commerce websites. Initially the sites will be wholesalers. I will provide the supplier URLs. Where required, I will provide login details.
Deliverables will be a csv file of the scraped data as well as the Python script.
Screenshots of the elements for a typical page on each site will be provided - they will usually be (where available):
- Product URL
- Product name
- Unit price (ex VAT)
- Case quantity
- EAN/UPC (barcode)
- SKU/Product code
The script should run in headless mode where practical.
A debug mode should be provided that allows me to pause the script, print out variables at key points then resume the script.
The site URL, login details and debug flag can be hard coded or read from command line switches or a config file.
Whilst the populated csv file is part of the deliverable, I will also run the script upon receipt to compare results.
I will be awarding this project to 2 or 3 suppliers, each having a different but similar sized website, to evaluate communication, speed of delivery and quality of coding, including comments.
Given that there will be multiple websites after the initial one, I am looking for a partner who can provide valuable guidance on how we can make the scraping process both cost-efficient and time-efficient. For there to be long-term revenue for a partner, the cost to scrape each website must be small - in the region of £25-50 per site. I am open to discussions on how this could be achieved.
The ideal long-term partner will also have MySql skills - the web scraping is part of a wider project.
Examples of sites you have scraped and the type of data you retrieved would be helpful.
Deliverables will be a csv file of the scraped data as well as the Python script.
Screenshots of the elements for a typical page on each site will be provided - they will usually be (where available):
- Product URL
- Product name
- Unit price (ex VAT)
- Case quantity
- EAN/UPC (barcode)
- SKU/Product code
The script should run in headless mode where practical.
A debug mode should be provided that allows me to pause the script, print out variables at key points then resume the script.
The site URL, login details and debug flag can be hard coded or read from command line switches or a config file.
Whilst the populated csv file is part of the deliverable, I will also run the script upon receipt to compare results.
I will be awarding this project to 2 or 3 suppliers, each having a different but similar sized website, to evaluate communication, speed of delivery and quality of coding, including comments.
Given that there will be multiple websites after the initial one, I am looking for a partner who can provide valuable guidance on how we can make the scraping process both cost-efficient and time-efficient. For there to be long-term revenue for a partner, the cost to scrape each website must be small - in the region of £25-50 per site. I am open to discussions on how this could be achieved.
The ideal long-term partner will also have MySql skills - the web scraping is part of a wider project.
Examples of sites you have scraped and the type of data you retrieved would be helpful.