Web Scraping App Creation
Budget: €250 – €750 EUR
I need an experienced developer to build a web scraping application tailored for extracting product data—including names, prices, and availability—from multiple e-commerce sites. The app should feature proxy support (e.g., ProxyMesh) for IP rotation to ensure data extraction remains uninterrupted by blocking mechanisms.
The initial focus will be on scraping the following required websites:
- cashconverters.pt
- amazon.es
- olx.pt
Additionally, support for scraping these optional websites is desired:
- worten.pt
- kuantukusta.pt
- pt.wallapop.com
Key features for the application include:
- Modular design for easy addition of new e-commerce sites.
- Proxy and IP rotation integration.
- Capability to handle dynamic content through Playwright.
- Efficient pagination handling for multi-page scraping.
- User-agent rotation for stealth operations.
- Filtering and search capabilities for scraped data based on price, keywords, categories, and availability.
- Robust error handling and retry logic to ensure reliability.
- Exporting data in JSON format.
Experience with Playwright is preferred for this project. Please ensure your application highlights your relevant experience in developing scalable and efficient web scraping solutions.
The initial focus will be on scraping the following required websites:
- cashconverters.pt
- amazon.es
- olx.pt
Additionally, support for scraping these optional websites is desired:
- worten.pt
- kuantukusta.pt
- pt.wallapop.com
Key features for the application include:
- Modular design for easy addition of new e-commerce sites.
- Proxy and IP rotation integration.
- Capability to handle dynamic content through Playwright.
- Efficient pagination handling for multi-page scraping.
- User-agent rotation for stealth operations.
- Filtering and search capabilities for scraped data based on price, keywords, categories, and availability.
- Robust error handling and retry logic to ensure reliability.
- Exporting data in JSON format.
Experience with Playwright is preferred for this project. Please ensure your application highlights your relevant experience in developing scalable and efficient web scraping solutions.