Python-Powered WooCommerce Web Scraper & Automation
Budget: ₹12,500 – ₹37,500 INR
Job Title:
Custom Web Scraper & Automation Script for WooCommerce Integration
Description:
We’re seeking an experienced Python developer to create a modular web scraping and automation system that integrates with our WooCommerce store. The goal is to extract product data from approximately 50 supplier websites (both static and JavaScript-rendered), update our store daily via cron job, and display supplier-specific data such as price and stock in a grouped product view.
The system must be scalable, resilient against anti-scraping measures, and hosted on a cloud platform such as AWS or Google Cloud.
---
Key Responsibilities:
Develop a modular Python scraper using a config file (JSON/YAML) for easy addition of new suppliers.
Extract detailed product data: name, SKU, description, price, stock level, images, etc.
Handle both static sites (Requests + BeautifulSoup) and JavaScript-heavy sites (Playwright or Selenium).
Normalize and group identical products using fuzzy matching across suppliers.
Display supplier options (price, availability, etc.) in a dynamic table on the product page.
Update WooCommerce store using the WooCommerce REST API.
Schedule daily automated updates via a cron job.
Implement rotating proxies and user-agent spoofing to bypass anti-scraping measures.
Provide deployment documentation for AWS or Google Cloud.
---
Technical Skills Required:
Strong proficiency in Python
Experience with web scraping tools: Requests, BeautifulSoup, Playwright/Selenium
Familiarity with WooCommerce REST API
Knowledge of HTML/CSS/JavaScript
Experience with cloud hosting (AWS/GCP preferred)
Experience handling large datasets and optimizing performance
---
Example Supplier Sites for Initial Testing:
Claygate
Fwhipkin
Ideal Bathrooms
Additional Information:
Expect iterative feedback and collaboration.
Initial testing will be done with sample data; real credentials and full supplier list will be provided after validation.
Custom Web Scraper & Automation Script for WooCommerce Integration
Description:
We’re seeking an experienced Python developer to create a modular web scraping and automation system that integrates with our WooCommerce store. The goal is to extract product data from approximately 50 supplier websites (both static and JavaScript-rendered), update our store daily via cron job, and display supplier-specific data such as price and stock in a grouped product view.
The system must be scalable, resilient against anti-scraping measures, and hosted on a cloud platform such as AWS or Google Cloud.
---
Key Responsibilities:
Develop a modular Python scraper using a config file (JSON/YAML) for easy addition of new suppliers.
Extract detailed product data: name, SKU, description, price, stock level, images, etc.
Handle both static sites (Requests + BeautifulSoup) and JavaScript-heavy sites (Playwright or Selenium).
Normalize and group identical products using fuzzy matching across suppliers.
Display supplier options (price, availability, etc.) in a dynamic table on the product page.
Update WooCommerce store using the WooCommerce REST API.
Schedule daily automated updates via a cron job.
Implement rotating proxies and user-agent spoofing to bypass anti-scraping measures.
Provide deployment documentation for AWS or Google Cloud.
---
Technical Skills Required:
Strong proficiency in Python
Experience with web scraping tools: Requests, BeautifulSoup, Playwright/Selenium
Familiarity with WooCommerce REST API
Knowledge of HTML/CSS/JavaScript
Experience with cloud hosting (AWS/GCP preferred)
Experience handling large datasets and optimizing performance
---
Example Supplier Sites for Initial Testing:
Claygate
Fwhipkin
Ideal Bathrooms
Additional Information:
Expect iterative feedback and collaboration.
Initial testing will be done with sample data; real credentials and full supplier list will be provided after validation.