Web Scraper for Brand Names & Google Search Data
Budget: €30 – €250 EUR
Hi
I'm looking to develop a web scraper that targets specific information from various brand websites. Here are the details of the project:
Objective: Create a web scraper to extract brand names from the following URL: https://www.feelunique.com/content/brands. Once the brand names are extracted, the scraper should then perform Google searches for each brand to identify websites listed within the first five pages of search results.
Key Data to Extract:
Brand Names from the specified URL.
From the Google search results:
Website URLs
Contact information from these URLs, specifically:
Email addresses
Phone numbers
Store names
Physical addresses
Requirements:
Ensure the scraper navigates and extracts data efficiently and respects robots.txt guidelines.
Implement error handling and data validation to ensure accuracy and completeness of the collected data.
The system should be capable of handling potential CAPTCHAs or other forms of anti-bot measures.
Deliverables:
A fully functional scraper script.
Documentation on how the script operates and any dependencies.
A simple user interface (if feasible within budget and timeline) for initiating scrapes and reviewing extracted data.
Questions for You:
Could you provide an estimated cost for the development of this tool?
What timeline are we looking at for the completion of this scraper?
Please let me know if you need further details or have any constraints to consider. Looking forward to your insights and confirmation.
Best regards,
Mathias
I'm looking to develop a web scraper that targets specific information from various brand websites. Here are the details of the project:
Objective: Create a web scraper to extract brand names from the following URL: https://www.feelunique.com/content/brands. Once the brand names are extracted, the scraper should then perform Google searches for each brand to identify websites listed within the first five pages of search results.
Key Data to Extract:
Brand Names from the specified URL.
From the Google search results:
Website URLs
Contact information from these URLs, specifically:
Email addresses
Phone numbers
Store names
Physical addresses
Requirements:
Ensure the scraper navigates and extracts data efficiently and respects robots.txt guidelines.
Implement error handling and data validation to ensure accuracy and completeness of the collected data.
The system should be capable of handling potential CAPTCHAs or other forms of anti-bot measures.
Deliverables:
A fully functional scraper script.
Documentation on how the script operates and any dependencies.
A simple user interface (if feasible within budget and timeline) for initiating scrapes and reviewing extracted data.
Questions for You:
Could you provide an estimated cost for the development of this tool?
What timeline are we looking at for the completion of this scraper?
Please let me know if you need further details or have any constraints to consider. Looking forward to your insights and confirmation.
Best regards,
Mathias