Bulk PDF Download Automation
Budget: ₹37,500 – ₹75,000 INR
I need to download around 10 million PDF documents from more than 40 government and commercial websites for data analysis.
Requirements:
- Develop a script or use existing tools to automate the download process.
- Ensure the solution can handle large volumes without crashing.
- Provide a way to verify the integrity of downloaded files.
Ideal Skills & Experience:
- Proficiency in scripting languages (Python, Bash, etc.)
- Experience with web scraping and automation tools
- Familiarity with handling large datasets and file management
Requirements:
- Develop a script or use existing tools to automate the download process.
- Ensure the solution can handle large volumes without crashing.
- Provide a way to verify the integrity of downloaded files.
Ideal Skills & Experience:
- Proficiency in scripting languages (Python, Bash, etc.)
- Experience with web scraping and automation tools
- Familiarity with handling large datasets and file management
Related categories:
PHP
Python
Web Scraping
Software Architecture
Data Analysis
Automation
Data Management
Bash