Python Price Scraper Optimisation
Budget: €8 – €30 EUR
I have a scrapper code on Python which needs optimisation.
Currently, it takes EAN from google sheets column A, then goes to website 1, checks for all EAN codes, then goes to website 2 etc., and once all prices are checked, it records prices found back in google sheets.
To do list:
1. code is to check prices on all added websites simultaneously;
2. code is to update prices on the fly in google sheets;
3. we are to migrate code to our server;
4. we are to add "activation" clause on google sheets (ie value "1" in column B, once price is fetched from all websites, value is changed to "2", and code scans periodically for "1" value and checks prices for those EAN codes that are 'activated');
5. scrapping to be added for amazon.de and amazon.fr
hardest part to sync the code with google sheets is done. Now I need it to run efficiently.
Currently, it takes EAN from google sheets column A, then goes to website 1, checks for all EAN codes, then goes to website 2 etc., and once all prices are checked, it records prices found back in google sheets.
To do list:
1. code is to check prices on all added websites simultaneously;
2. code is to update prices on the fly in google sheets;
3. we are to migrate code to our server;
4. we are to add "activation" clause on google sheets (ie value "1" in column B, once price is fetched from all websites, value is changed to "2", and code scans periodically for "1" value and checks prices for those EAN codes that are 'activated');
5. scrapping to be added for amazon.de and amazon.fr
hardest part to sync the code with google sheets is done. Now I need it to run efficiently.