Efficient, Multifaceted Data Miner for Music Industry Trends
Budget: £250 – £750 GBP
Experienced Web Scraping & Proxy Integration Expert for Multi-Retailer Product Tracking System
Project Overview
We are seeking a seasoned freelancer to develop an advanced product tracking system tailored for a range of high-end and budget retailers. The system must reliably track product data—including price, availability, and error monitoring—across multiple platforms such as Argos, Boots, Entertainer, iHerb,Superdrug, House Of Fraser, Game and others. Additionally, the system must integrate robust proxy solutions to ensure uninterrupted access and avoid IP bans during high-volume scraping operations.
Job Responsibilities
System Development: Architect and build a comprehensive product tracking solution that can handle data extraction from a diverse set of retailers with varying website structures and anti-scraping measures.
Proxy Integration: Implement reliable proxy rotation and management to bypass IP blocking mechanisms, ensuring continuous and smooth data collection.
Data Processing: Develop a robust backend to process and store scraped data, applying filters to remove noise and deliver only actionable insights.
Dashboard & Alerts: Create a user-friendly dashboard with customizable filters and alert mechanisms that can be tailored for each retailer.
Testing & Optimization: Conduct thorough testing across all targeted websites, fine-tuning the scraping logic and proxy configurations to maximize efficiency and accuracy.
Essential Qualifications
Proven Track Record: You must have demonstrable experience in developing web scraping solutions and integrating proxy services, particularly for large-scale, multi-website product tracking.
Technical Expertise: Proficiency in languages such as Python (with libraries like BeautifulSoup, Scrapy, Selenium) or similar technologies that facilitate robust scraping and proxy management.
Portfolio Requirement: In your first message, you must include a screenshot (or multiple screenshots) and a brief description of similar projects you have built. Generic greetings or “Hello” messages without detailed examples will be automatically disregarded.
Please provide concise details about your approach, tools, and previous similar implementations.
Application Instructions
Mandatory Requirement: When submitting your proposal, please include a screenshot or detailed evidence of a similar product tracking or web scraping system that you have built.
No Generic Greetings: Proposals starting with generic greetings like “Hello” without any specific evidence of similar work will not be considered.
Project Overview
We are seeking a seasoned freelancer to develop an advanced product tracking system tailored for a range of high-end and budget retailers. The system must reliably track product data—including price, availability, and error monitoring—across multiple platforms such as Argos, Boots, Entertainer, iHerb,Superdrug, House Of Fraser, Game and others. Additionally, the system must integrate robust proxy solutions to ensure uninterrupted access and avoid IP bans during high-volume scraping operations.
Job Responsibilities
System Development: Architect and build a comprehensive product tracking solution that can handle data extraction from a diverse set of retailers with varying website structures and anti-scraping measures.
Proxy Integration: Implement reliable proxy rotation and management to bypass IP blocking mechanisms, ensuring continuous and smooth data collection.
Data Processing: Develop a robust backend to process and store scraped data, applying filters to remove noise and deliver only actionable insights.
Dashboard & Alerts: Create a user-friendly dashboard with customizable filters and alert mechanisms that can be tailored for each retailer.
Testing & Optimization: Conduct thorough testing across all targeted websites, fine-tuning the scraping logic and proxy configurations to maximize efficiency and accuracy.
Essential Qualifications
Proven Track Record: You must have demonstrable experience in developing web scraping solutions and integrating proxy services, particularly for large-scale, multi-website product tracking.
Technical Expertise: Proficiency in languages such as Python (with libraries like BeautifulSoup, Scrapy, Selenium) or similar technologies that facilitate robust scraping and proxy management.
Portfolio Requirement: In your first message, you must include a screenshot (or multiple screenshots) and a brief description of similar projects you have built. Generic greetings or “Hello” messages without detailed examples will be automatically disregarded.
Please provide concise details about your approach, tools, and previous similar implementations.
Application Instructions
Mandatory Requirement: When submitting your proposal, please include a screenshot or detailed evidence of a similar product tracking or web scraping system that you have built.
No Generic Greetings: Proposals starting with generic greetings like “Hello” without any specific evidence of similar work will not be considered.
Related categories:
PHP
Business, Accounting, Human Resources & Legal
Python
Web Scraping
Data Mining