Allegro Data Scraping Solution
Budget: €10 – €50 EUR
I’m looking for a skilled developer to help optimize or rewrite a script for data scraping from allegro.pl. The goal is to scrape item URLs and download their HTML content efficiently while ensuring smooth operation.
Current Situation:
I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached).
The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable.
What I Need:
A robust and reliable solution for faster and more efficient scraping without interruptions.
The ability to download HTML files in the required structure.
Ideally, transitioning to a Python-based solution for better performance, flexibility, and scalability.
If you have experience building efficient web scraping solutions for platforms with similar security measures, I’d love to hear your ideas and approach to this project.
Looking forward to working with you!
Current Situation:
I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached).
The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable.
What I Need:
A robust and reliable solution for faster and more efficient scraping without interruptions.
The ability to download HTML files in the required structure.
Ideally, transitioning to a Python-based solution for better performance, flexibility, and scalability.
If you have experience building efficient web scraping solutions for platforms with similar security measures, I’d love to hear your ideas and approach to this project.
Looking forward to working with you!