Scrap webpage, export files, host and dowload files
Budget: $30 – $250 USD
Hi! I've a Python scrapping project that will require:
1. Scrapping 4 URLs that will generate about 2,000 pages and collect about 60 data points in each data row
2. The data is very well structured (samples here: https://www.base.gov.pt/Base4/pt/detalhe/?type=contratos&id=6222284)
3. The explanation of data that needs scrapping is here: https://screencast-o-matic.com/watch/cr1ZQyV1tK1
4. No login required
5. Deliverables are:
5.1 Scrapper code
5.2 Deployed on Scrapy Cloud
5.3 Instructions on how to operate it fully (consider operators have no coding skills)
5.4 Exported Excel File with all exported content
5.5 Google Drive (created ad-hoc) to host all downloaded files
Attached is the Excel sheet mentioned on the video AND the webpage URL to be scrapped.
1. Scrapping 4 URLs that will generate about 2,000 pages and collect about 60 data points in each data row
2. The data is very well structured (samples here: https://www.base.gov.pt/Base4/pt/detalhe/?type=contratos&id=6222284)
3. The explanation of data that needs scrapping is here: https://screencast-o-matic.com/watch/cr1ZQyV1tK1
4. No login required
5. Deliverables are:
5.1 Scrapper code
5.2 Deployed on Scrapy Cloud
5.3 Instructions on how to operate it fully (consider operators have no coding skills)
5.4 Exported Excel File with all exported content
5.5 Google Drive (created ad-hoc) to host all downloaded files
Attached is the Excel sheet mentioned on the video AND the webpage URL to be scrapped.