Scrapy Automation for Web File Downloads

Job ID: 38168445

Budget: $30 – $250 USD

I'm looking for a Scrapy expert to develop a script that automates the daily download of files from a web portal.

We need to download files from different web portals developed with different frameworks.
We already have a main application which calls scrapy "engines" to download the files.

This project will require:
- Proficiency in Scrapy and web scraping techniques.
- Strong Python programming skills.
- Experience in automating file downloads.

I'm looking for someone who can provide a reliable and easily maintainable solution. Please share your relevant experience with web scraping, Scrapy and automation in your bid.

The bid must be related to the development of 1 single engine, we will need to develop multiple engines.