Build a Dynamic Web scraper using REACT and NodeJs
Budget: £250 – £750 GBP
Here is the work flow and we can discuss more in chat.
Client can enter URL for any site and target specific DOM body ID. E.g:
URL: www.example.com
Content ID: #containerX
First the scraper will get a sitemap for the domain (can connect to 3rd party paid Sitemapper API if needed).
Once for example you have 30 URLS to scrape then you target them individually.
Once each URL is scraped then we allow user to moderate the scraped content and edit.
If user is happy with the content then they can choose to publish or delete. If deleted then the URL is blacklisted from scraping again for update. If user click publish then the content get sent to another website Wordpress RESTful API and publish it as a post with best SEO practises (can use ChatGPT api to enhance SEO keywords and meta tag if needed). IF user clicks edit on a scraped and published content then it should take them to the wordpress edit page for that published article.
Client can enter URL for any site and target specific DOM body ID. E.g:
URL: www.example.com
Content ID: #containerX
First the scraper will get a sitemap for the domain (can connect to 3rd party paid Sitemapper API if needed).
Once for example you have 30 URLS to scrape then you target them individually.
Once each URL is scraped then we allow user to moderate the scraped content and edit.
If user is happy with the content then they can choose to publish or delete. If deleted then the URL is blacklisted from scraping again for update. If user click publish then the content get sent to another website Wordpress RESTful API and publish it as a post with best SEO practises (can use ChatGPT api to enhance SEO keywords and meta tag if needed). IF user clicks edit on a scraped and published content then it should take them to the wordpress edit page for that published article.