Web Scraper for Auto Parts Pricing

Job ID: 39655420

Budget: $250 – $750 USD

I'm looking for an experienced developer to create a web scraper that can compare the prices of approximately 100,000 auto parts on my website with those of competing e-commerce sites in Turkey. The goal is to ensure competitive pricing and stay ahead in the market.

Key Requirements:
- Develop a web scraper to extract pricing data from the following e-commerce sites: Trendyol, Hepsiburada, N11, and additional sites including https://www.onlineyedekparca.com/, https://www.aloparca.com/, https://otoparcasan.com/, https://ucuzaparca.com/, https://www.parcafilosu.com.tr/, and https://www.yedekparca.com.tr/.
- The scraper must be able to handle a large volume of products efficiently.
- Implement a system to update price comparisons daily.
- Ensure the scraper is robust and can handle changes in website structures or layouts.

Ideal Skills and Experience:
- Strong experience in web scraping and data extraction.
- Familiarity with e-commerce platforms and their structures.
- Proficiency in programming languages commonly used for web scraping, such as Python or JavaScript.
- Ability to manage and process large datasets effectively.
- Experience with scheduling and automating tasks for regular updates.

If you have the expertise to develop a reliable and efficient web scraping solution for this project, I would love to hear from you.