Download and Save 50,000 Webpages as HTML
Budget: $30 – $250 USD
I need an experienced freelancer to download and save HTML files from a list of URLs from a csv file. I have a minimum of 20,000 URLs, and depending on the cost, I may increase the request to download up to 50,000 URLs. All the URLs are from one website with the same format. Please I only need your help downloading them as individual html files. No further processing is needed.
Requirements:
- Use a custom prefix and sequential number for the naming of the HTML files (there is column in the csv file).
- Store all files in one folder.
- Ensure each HTML file is fully downloaded and not corrupted by confirming file size or content structure.
Please note:
- None of the URLs require authentication or login credentials.
The project needs to be completed within 2 weeks.
Requirements:
- Use a custom prefix and sequential number for the naming of the HTML files (there is column in the csv file).
- Store all files in one folder.
- Ensure each HTML file is fully downloaded and not corrupted by confirming file size or content structure.
Please note:
- None of the URLs require authentication or login credentials.
The project needs to be completed within 2 weeks.