Web scraping using Scrapy on Raspberry Pi -- 2
Budget: £10 – £20 GBP
We would like to setup an automated web scraper to run on several websites and retrieve product name, description, image URLs, and updated prices and put these in a Google sheet.
Project questions
1. What technologies should be used to implement the scraper? Scrapy in Python running on a Raspberry Pi, or Zyte
2. What websites will the scraper need to run on?
https://www.habitech.co.uk/
https://oneav.co.uk/
https://www.alltrade.co.uk/
Please note, some of the websites require a login to show prices, I can supply Html files with the pricing information to setup the scraper.
3. How long do you want the scraper to run for?
The scraper needs to be run once to gather the content, then run weekly to capture any new products or price or stock level changes
Project questions
1. What technologies should be used to implement the scraper? Scrapy in Python running on a Raspberry Pi, or Zyte
2. What websites will the scraper need to run on?
https://www.habitech.co.uk/
https://oneav.co.uk/
https://www.alltrade.co.uk/
Please note, some of the websites require a login to show prices, I can supply Html files with the pricing information to setup the scraper.
3. How long do you want the scraper to run for?
The scraper needs to be run once to gather the content, then run weekly to capture any new products or price or stock level changes