One-Time File Download Scraper
Budget: ₹1,500 – ₹12,500 INR
I need a small script that will visit a specific site (I will share the URL and login details after award), locate every file that meets my criteria, and download those files to a local folder. The job is a single run only; once the files are saved, the task is complete.
A lightweight Python solution is ideal; standard libraries such as requests, BeautifulSoup, or Selenium are all fine as long as the finished script:
• Logs in or navigates past any simple gating the site uses
• Crawls the relevant pages and identifies the target files (PDFs and ZIPs in my case)
• Saves each file locally, keeping the original filename intact
• Produces a short README so I can rerun the scraper later if needed
Please keep the code clean, commented, and fully self-contained—no proprietary frameworks. Let me know at the start if the site’s structure suggests a more efficient tool such as Scrapy; I’m flexible as long as the deliverable runs on a standard Python 3.x environment.
A lightweight Python solution is ideal; standard libraries such as requests, BeautifulSoup, or Selenium are all fine as long as the finished script:
• Logs in or navigates past any simple gating the site uses
• Crawls the relevant pages and identifies the target files (PDFs and ZIPs in my case)
• Saves each file locally, keeping the original filename intact
• Produces a short README so I can rerun the scraper later if needed
Please keep the code clean, commented, and fully self-contained—no proprietary frameworks. Let me know at the start if the site’s structure suggests a more efficient tool such as Scrapy; I’m flexible as long as the deliverable runs on a standard Python 3.x environment.
Related categories:
JavaScript
Python
Web Scraping
Software Architecture
Scrapy
Data Extraction
BeautifulSoup
Selenium