Auto Parts Stores Data Scraping
Budget: $30 – $250 CAD
I am looking for an experienced freelancer to scrape auto parts store data across 7,500 towns in the USA . The freelancer will be responsible for scraping the following information from Google search results:
- Store name and address
- Contact information
- Website (if any)
- Contact person's name (if available)
The towns / cities names will be provided in an Excel sheet, and the freelancer will need to:
Search for auto parts stores in each town via Google.
Scrape the relevant data (store name, contact number, address, website).
Compile and organize the scraped data into an Excel file.
Requirements:
Experience with web scraping and the use of tools like Selenium, BeautifulSoup, or Scrapy.
Experience using Google Custom Search API or SerpApi to extract structured results from Google searches.
Proficiency with Excel (to organize and output the data in a structured format).
Ability to work with proxy services and Captcha solving if needed, to avoid IP blocking while scraping a large number of searches.
Provide regular updates on progress and any challenges encountered during the scraping process.
Project Breakdown:
Task: Scrape data for 7,500 towns listed in the provided Excel sheet.
For each town, perform a Google search for "auto parts stores in [town name]".
Extract the store name, contact number, address, and website URL (if available).
Organize the results in an Excel sheet with clearly labeled columns (town, store name, contact number, address, website).
Data Delivery: The final output should be an Excel file containing the scraped data for each town.
Tools and Services:
Google Custom Search API or SerpApi will be used to perform searches for each town.
Proxies may be needed to prevent IP blocking, depending on the volume of searches.
If required, Captcha solving services (e.g., 2Captcha or Anti-Captcha) should be integrated.
Budget:
API Costs: The freelancer will need to use Google Custom Search API or SerpApi, which may have associated costs (e.g., $5 per 1,000 queries for Google Custom Search API).
Proxies: The freelancer will need to use a proxy service (e.g., ProxyMesh, Smartproxy) to avoid IP blocks. The cost for proxies will be $20 per month.
Captcha Solving: If CAPTCHA is encountered, solving services will be required, and the cost will be $5–$10 for the required CAPTCHAs.
Total Estimated Cost: The freelancer will handle the costs for API usage, proxies, and CAPTCHA solving, with a total estimated cost of $57 for the initial setup and $20 for proxy usage.
Timeline:
Initial Sample: Provide a sample for three[3] towns within 1–2 days.
Full Data Collection: Complete the scraping for all 7,500 towns within 7–10 days.
- Store name and address
- Contact information
- Website (if any)
- Contact person's name (if available)
The towns / cities names will be provided in an Excel sheet, and the freelancer will need to:
Search for auto parts stores in each town via Google.
Scrape the relevant data (store name, contact number, address, website).
Compile and organize the scraped data into an Excel file.
Requirements:
Experience with web scraping and the use of tools like Selenium, BeautifulSoup, or Scrapy.
Experience using Google Custom Search API or SerpApi to extract structured results from Google searches.
Proficiency with Excel (to organize and output the data in a structured format).
Ability to work with proxy services and Captcha solving if needed, to avoid IP blocking while scraping a large number of searches.
Provide regular updates on progress and any challenges encountered during the scraping process.
Project Breakdown:
Task: Scrape data for 7,500 towns listed in the provided Excel sheet.
For each town, perform a Google search for "auto parts stores in [town name]".
Extract the store name, contact number, address, and website URL (if available).
Organize the results in an Excel sheet with clearly labeled columns (town, store name, contact number, address, website).
Data Delivery: The final output should be an Excel file containing the scraped data for each town.
Tools and Services:
Google Custom Search API or SerpApi will be used to perform searches for each town.
Proxies may be needed to prevent IP blocking, depending on the volume of searches.
If required, Captcha solving services (e.g., 2Captcha or Anti-Captcha) should be integrated.
Budget:
API Costs: The freelancer will need to use Google Custom Search API or SerpApi, which may have associated costs (e.g., $5 per 1,000 queries for Google Custom Search API).
Proxies: The freelancer will need to use a proxy service (e.g., ProxyMesh, Smartproxy) to avoid IP blocks. The cost for proxies will be $20 per month.
Captcha Solving: If CAPTCHA is encountered, solving services will be required, and the cost will be $5–$10 for the required CAPTCHAs.
Total Estimated Cost: The freelancer will handle the costs for API usage, proxies, and CAPTCHA solving, with a total estimated cost of $57 for the initial setup and $20 for proxy usage.
Timeline:
Initial Sample: Provide a sample for three[3] towns within 1–2 days.
Full Data Collection: Complete the scraping for all 7,500 towns within 7–10 days.