Expert Python Developer for Scraping to Evolve Existing Application
Budget: €8 – €30 EUR
I am looking for a Python developer with extensive experience in web scraping using Scrapy to support and develop enhancements for an existing application. Due to the project's nature, constant adjustments, and the need for new functionalities, we seek a medium to long-term collaboration with a dedication of 10 to 20 hours per week (with occasional peaks requiring more dedication).
Preferably Spanish-speaking (to facilitate management), but English is also acceptable.
I have a technology project based on web scraping. However, it's a bit special because it involves navigating through governmental pages using an individual's credentials (Digital Certificate).
Scraping is done using Scrapy, but HTTP calls are made using a library provided by our client, which (using cURL, HTTP, or SOAP depending on the case) executes authenticated HTTP calls to navigate.
The scraping processes involve navigating through certain web pages, filling out forms to gain access to specific documents, downloading them, and uploading them to an external system via an API endpoint.
Sometimes, the pages we need to navigate are straightforward (HTML, sending data via forms, etc.), while other times they involve interacting with JavaScript applications to achieve the same results. Therefore, you need the experience and skill to manage scraping both simple web pages and those that require interaction with JavaScript (understanding that since HTTP calls must be made with our client's library, we can't use any other library).
Preferably Spanish-speaking (to facilitate management), but English is also acceptable.
I have a technology project based on web scraping. However, it's a bit special because it involves navigating through governmental pages using an individual's credentials (Digital Certificate).
Scraping is done using Scrapy, but HTTP calls are made using a library provided by our client, which (using cURL, HTTP, or SOAP depending on the case) executes authenticated HTTP calls to navigate.
The scraping processes involve navigating through certain web pages, filling out forms to gain access to specific documents, downloading them, and uploading them to an external system via an API endpoint.
Sometimes, the pages we need to navigate are straightforward (HTML, sending data via forms, etc.), while other times they involve interacting with JavaScript applications to achieve the same results. Therefore, you need the experience and skill to manage scraping both simple web pages and those that require interaction with JavaScript (understanding that since HTTP calls must be made with our client's library, we can't use any other library).