Speed-up Python Scripts
Budget: £18 – £36 GBP
I have 3 python scripts/modules that need speeding up.
Script 1 uses imap_tools to scrape links from emails. The emails don't contain much data but it takes between 5 and 25 seconds to get the links.
Script 2 harvests data from an API and stores it in a mysql database. Only 3 records are stored at any time so using a separate database seems unnecessary and must slow it down.
Once Script 1 has scraped a link Script 3 scrapes data from the link website using Selenium and data harvested by Script 2. Selenium and the websites are very slow to load even though there is not much content on the webpage.
Knowledge of Selenium, captcha APIs and ideally imap_tools is required.
Script 1 uses imap_tools to scrape links from emails. The emails don't contain much data but it takes between 5 and 25 seconds to get the links.
Script 2 harvests data from an API and stores it in a mysql database. Only 3 records are stored at any time so using a separate database seems unnecessary and must slow it down.
Once Script 1 has scraped a link Script 3 scrapes data from the link website using Selenium and data harvested by Script 2. Selenium and the websites are very slow to load even though there is not much content on the webpage.
Knowledge of Selenium, captcha APIs and ideally imap_tools is required.