Romanian E-Commerce Web Crawler Development
Budget: $250 – $750 USD
Project Description:
I am looking for a developer to build a web crawling script that collects product and price data from Romanian online stores, similar to the functionality offered by Pricy.ro. The script should scrape product name, price, description, availability, discounts, and URLs, and store the data in a structured database.
Requirements:
Crawl multiple Romanian e-commerce websites.
Handle different site structures and pagination.
Save historical prices to track changes over time.
Generate basic statistics (price trends, best prices, price drops).
Scalable and modular to easily add new stores.
Simple admin dashboard to manage and monitor crawls and add affiliate links when click on crawled product links
Technical Notes:
Preferred technologies: Python (Scrapy, BeautifulSoup) or Node.js, but open to suggestions.
Code should be clean, documented, and robust against website changes.
Deliverables:
Web crawler scripts.
Database schema and setup.
Basic usage documentation.
Admin interface.
Application Instructions:
Share examples of similar projects you have completed.
Suggest the tech stack you would use.
Mention any improvements or ideas you recommend.
Timeline:
Prototype expected in 2–4 weeks.
I am looking for a developer to build a web crawling script that collects product and price data from Romanian online stores, similar to the functionality offered by Pricy.ro. The script should scrape product name, price, description, availability, discounts, and URLs, and store the data in a structured database.
Requirements:
Crawl multiple Romanian e-commerce websites.
Handle different site structures and pagination.
Save historical prices to track changes over time.
Generate basic statistics (price trends, best prices, price drops).
Scalable and modular to easily add new stores.
Simple admin dashboard to manage and monitor crawls and add affiliate links when click on crawled product links
Technical Notes:
Preferred technologies: Python (Scrapy, BeautifulSoup) or Node.js, but open to suggestions.
Code should be clean, documented, and robust against website changes.
Deliverables:
Web crawler scripts.
Database schema and setup.
Basic usage documentation.
Admin interface.
Application Instructions:
Share examples of similar projects you have completed.
Suggest the tech stack you would use.
Mention any improvements or ideas you recommend.
Timeline:
Prototype expected in 2–4 weeks.