Python Web Crawler and Stock Automation Tool

Job ID: 39569939

Budget: £250 – £750 GBP

I have partially completed this project myself, but need a professional to come and perfect it.

I'm looking for a Python developer to create a web crawling and stock automation tool. This tool will be used to extract complete product details from specific websites and update stock levels on WooCommerce daily.

Key Requirements:
- Web crawler to extract complete product details (prices, stock levels, descriptions).
- Ability to gather data from specific websites.
- Daily updates of stock data on WooCommerce.

Ideal Skills and Experience:
- Proficiency in Python & playwright
- Experience with web scraping tools and libraries (e.g., Beautiful Soup, Scrapy).
- Knowledge of WooCommerce and WordPress.
- Ability to set up automated tasks and ensure data accuracy.

Process:
Scrape product listings page on 6 sites and build out product lists with URL's
Compare to the products we have:
- Create new
- Update existing
- Upload images via wordpress media API
- Create products via woo commerce API

I have pretty much completed the process for 1 site, but a few issues like product descriptions beinf truncated or malformed. Also have 4 more sites to target.

Looking for a reliable and efficient solution to streamline my stock management.