Web scraping tool for categorizing extracted information
Budget: $250 – $750 USD
You create a tool, which would scrape a website, and extract the information to understand the kind of page it is for example Product page, recipe, blog, portfolio, etc.
Then extract more info from the page like if it's a product page, get the price, reviews, etc. I would provide detailed info on what needs to be scraped for each category.
The scraped data should be saved in a JSON file with a pre-defined structure.
I would like to know, if you would you use some kind of ML or AI for this.
Rest we can discuss, I can also help you with a Python program that can discover all the URLs on a website. First please answer how can you detect the classification & takeout the data.
Then extract more info from the page like if it's a product page, get the price, reviews, etc. I would provide detailed info on what needs to be scraped for each category.
The scraped data should be saved in a JSON file with a pre-defined structure.
I would like to know, if you would you use some kind of ML or AI for this.
Rest we can discuss, I can also help you with a Python program that can discover all the URLs on a website. First please answer how can you detect the classification & takeout the data.