Python Code for E-commerce Price Scraping
Budget: $50 – $200 USD
I'm looking for a skilled Python developer to write code that will scrape prices from e-commerce sites. The code needs to be able to imitate clicking on a 'load more' button or scrolling until all data is loaded. Ultimately, the code should collect the data in JSON format and send it to a database.
The data need to be scraped daily.
Requirements:
- The code needs to run on Google Cloud.
- Data should be saved to a Cloud SQL server.
- Expertise in Python and web scraping is a must.
- Familiarity with Google Cloud services and SQL servers is necessary.
- Include proxy rotation to avoid IP blocking while scraping the data.
Most important!!! I need a python expert and not a newbie who program python with GPT.
The flow is very simple:
Get a page path from a list of pages (with pageId), scrape this page, return Json data to server with pageID. one prices page per query, no deep scraping.
The data need to be scraped daily.
Requirements:
- The code needs to run on Google Cloud.
- Data should be saved to a Cloud SQL server.
- Expertise in Python and web scraping is a must.
- Familiarity with Google Cloud services and SQL servers is necessary.
- Include proxy rotation to avoid IP blocking while scraping the data.
Most important!!! I need a python expert and not a newbie who program python with GPT.
The flow is very simple:
Get a page path from a list of pages (with pageId), scrape this page, return Json data to server with pageID. one prices page per query, no deep scraping.