Python BeautifulSoup Web Scraping Scripts
Budget: €10 – €30 EUR
I'm looking for a Python developer to write two web scraping scripts (BeautifulSoup) for two websites.
Scope of the Script:
- must be written in Python (v3) using BeautifulSoup (v4)
- One script for one website (I need in total two similar scripts)
- must be able to extract the product name, product descriptions (only text), product image (only the main image if there are more) and the product URL
- script should save the scraped information into a local MySQL DB (use your own DB, use "CREATE TABLE IF NOT EXISTS" inside your script)
- script needs to run on a daily basis, to check if there is a new product. For that task it should compare the product name with the content already inside the MySQL DB. If the product is already scraped, then it should update it (if needed).
- script should add the date & time when a product was added to the mySQL DB
- script should be able to run under linux
- must scrape the HTML source, not a RSS Feed or similar
- must use comments inside the script to understand it
Time to be done:
I do not have a timeframe for that task and its not very urgent. I you require 1, 2, 7 days or more its OK for me.
Ideal Skills and Experience:
- Proficiency in Python and web scraping libraries such as BeautifulSoup.
- Ability to write clean, efficient code.
- Familiarity with mySQL in Python.
Scope of the Script:
- must be written in Python (v3) using BeautifulSoup (v4)
- One script for one website (I need in total two similar scripts)
- must be able to extract the product name, product descriptions (only text), product image (only the main image if there are more) and the product URL
- script should save the scraped information into a local MySQL DB (use your own DB, use "CREATE TABLE IF NOT EXISTS" inside your script)
- script needs to run on a daily basis, to check if there is a new product. For that task it should compare the product name with the content already inside the MySQL DB. If the product is already scraped, then it should update it (if needed).
- script should add the date & time when a product was added to the mySQL DB
- script should be able to run under linux
- must scrape the HTML source, not a RSS Feed or similar
- must use comments inside the script to understand it
Time to be done:
I do not have a timeframe for that task and its not very urgent. I you require 1, 2, 7 days or more its OK for me.
Ideal Skills and Experience:
- Proficiency in Python and web scraping libraries such as BeautifulSoup.
- Ability to write clean, efficient code.
- Familiarity with mySQL in Python.