Google Shopping Price Data Extractor
Budget: $30 – $250 USD
We are seeking a skilled Python developer with expertise in Google Shopping price scraping to enhance our existing scraper or build a new one.
The current scraper we have, which successfully imported data into an SQL database, scraped prices on Google Shopping using EAN/barcode for The Netherlands. However, recent changes implemented by Google now restrict scraping/searching solely based on EAN code. Our attempts to replace the EAN code with the product name have resulted in unreliable results.
What we need:
Dashboard with WYSIWYG Interface: Develop a scraper with a user-friendly dashboard to cater to both technical and non-technical users. The dashboard should facilitate easy input and configuration.
Input Data: Utilize a provided CSV file (see attachment 'input_scraper.csv') containing product data. While searching based on EAN is preferable, searching on the full product name is also acceptable.
Scraping Requirements:
Search Google Shopping (localized for The Netherlands) for the products listed in the CSV.
Scrape the two lowest prices along with the names of the competing sellers.
Maintain a reasonable delay between search attempts to avoid detection and blocking by Google Shopping.
Export Results: After completing the scrape, export the results to a CSV file (see attachment 'minimal-output-desired.csv'). The exported data should include the two lowest offers, including shipping costs.
Important Considerations:
IP Blocking: Google Shopping is sensitive to scraping activities. Implement strategies to prevent IP blocking, such as introducing delays between search attempts.
Localization: The scraper should be tested and configured to work specifically for The Netherlands. VPN testing during development is acceptable, but the final product must seamlessly integrate into our system.
Payment: Compensation will be based on successful results, not attempts. We are looking for a reliable and effective solution.
Existing Scraper: We are open to sharing the current scraper (which is not currently functional) once we are confident that we are on the right track.
In summary, we require a standalone scraper with a user-friendly dashboard for scraping prices from Dutch Google Shopping. The scraper should export the results of the two lowest offers, considering potential challenges posed by Google's recent changes to shopping functionalities.
Availabe on request: Old Scraper in zipped file
The current scraper we have, which successfully imported data into an SQL database, scraped prices on Google Shopping using EAN/barcode for The Netherlands. However, recent changes implemented by Google now restrict scraping/searching solely based on EAN code. Our attempts to replace the EAN code with the product name have resulted in unreliable results.
What we need:
Dashboard with WYSIWYG Interface: Develop a scraper with a user-friendly dashboard to cater to both technical and non-technical users. The dashboard should facilitate easy input and configuration.
Input Data: Utilize a provided CSV file (see attachment 'input_scraper.csv') containing product data. While searching based on EAN is preferable, searching on the full product name is also acceptable.
Scraping Requirements:
Search Google Shopping (localized for The Netherlands) for the products listed in the CSV.
Scrape the two lowest prices along with the names of the competing sellers.
Maintain a reasonable delay between search attempts to avoid detection and blocking by Google Shopping.
Export Results: After completing the scrape, export the results to a CSV file (see attachment 'minimal-output-desired.csv'). The exported data should include the two lowest offers, including shipping costs.
Important Considerations:
IP Blocking: Google Shopping is sensitive to scraping activities. Implement strategies to prevent IP blocking, such as introducing delays between search attempts.
Localization: The scraper should be tested and configured to work specifically for The Netherlands. VPN testing during development is acceptable, but the final product must seamlessly integrate into our system.
Payment: Compensation will be based on successful results, not attempts. We are looking for a reliable and effective solution.
Existing Scraper: We are open to sharing the current scraper (which is not currently functional) once we are confident that we are on the right track.
In summary, we require a standalone scraper with a user-friendly dashboard for scraping prices from Dutch Google Shopping. The scraper should export the results of the two lowest offers, considering potential challenges posed by Google's recent changes to shopping functionalities.
Availabe on request: Old Scraper in zipped file