Dynamic website scrape

Job ID: 30873889

Budget: $30 – $250 AUD

Need a python script which can be used to scrape the data of a public facing website. The page is fairly straightforward in its structure however there is a button that needs to be invoked so that it loads more data. The page needs to be loaded in its entirety, i.e. all data needs to be loaded and scraped. There are many 'divs' on the page but they are all the same structure and only a handful of items per div need to be scraped: name, location, date and time and a URL.

In addition for each element there is a link to a separate page from where there are additional data items to be included.

Data needs to be collected into a flat file so it can be easily uploaded. The script needs to be scheduled to run (I can do that once I receive the script).

I can provide more details to the bidders.

Thanks,
Related categories: Python Web Scraping Data Integration