Website Document Crawler
Budget: ₹1,500 – ₹12,500 INR
I need a comprehensive web crawler to download all PDFs and Word documents from the entire website, https://www.indiacode.nic.in.
Requirements:
- Crawl the entire site, including all sublinks and subpages.
- Download both PDFs and Word documents.
- Organize the downloaded files by page structure.
Ideal Skills and Experience:
- Proficiency in web scraping tools and techniques.
- Experience handling large-scale downloads and maintaining folder structures.
- Familiarity with Python, BeautifulSoup, or similar technologies.
Please provide examples of similar work done.
Requirements:
- Crawl the entire site, including all sublinks and subpages.
- Download both PDFs and Word documents.
- Organize the downloaded files by page structure.
Ideal Skills and Experience:
- Proficiency in web scraping tools and techniques.
- Experience handling large-scale downloads and maintaining folder structures.
- Familiarity with Python, BeautifulSoup, or similar technologies.
Please provide examples of similar work done.