Data Scrape Project
Budget: $250 – $750 USD
I want someone to write a program that will run in Windows 10 to scrape data from 2 websites (https://simplybearings.co.uk/shop/ and https://www.bearing-king.co.uk/).
I want to be able to specify the time delay (ms) between each query to a site to prevent any heavy load on the sites. The collected data must be saved to separate either Excel spreadsheets or some database file(s).
The data needs to be categorised properly e.g. Main category, sub category 1, sub category 2, sub category 3 etc..
I want to be able to repeat the process and update any changes to previously collected data. The program should display its progress on screen. In the case of repeat crawl, the progress should indicate likely end time.
Generic / automated bids will be ignored. Please check out the sites and bid after careful consideration.
I want to be able to specify the time delay (ms) between each query to a site to prevent any heavy load on the sites. The collected data must be saved to separate either Excel spreadsheets or some database file(s).
The data needs to be categorised properly e.g. Main category, sub category 1, sub category 2, sub category 3 etc..
I want to be able to repeat the process and update any changes to previously collected data. The program should display its progress on screen. In the case of repeat crawl, the progress should indicate likely end time.
Generic / automated bids will be ignored. Please check out the sites and bid after careful consideration.