Scraping/crawling expert needed to help with python scraping script
Budget: €10 – €25 EUR
We have a python script that scrapes data from some subscription website that requires you to be logged in in order to see some data. It uses Selenium + firefox driver.
I was working fine until recently, it seems the website changed the site structure and the way to look for the data we're looking for. It looks like it's loading the data with javascript.
Important: this site requieres login, we use cookies with the script so we can scrape the data as if we were logged in. This still works but we can't pull the data out of the website.
Please, include in you offer your experience working with python+scraping+selenium and what what would be your approach to solve the issues.
I was working fine until recently, it seems the website changed the site structure and the way to look for the data we're looking for. It looks like it's loading the data with javascript.
Important: this site requieres login, we use cookies with the script so we can scrape the data as if we were logged in. This still works but we can't pull the data out of the website.
Please, include in you offer your experience working with python+scraping+selenium and what what would be your approach to solve the issues.