FAST WebPage change alert, scraper
Budget: $30 – $250 USD
We're looking to build some software that would allow us to be alerted instantly when certain newspaper/blog add articles. At first we'd want this to be enabled on about 10 sites to confirm the functionality. Once this is done we'd like to expand to multiples of that and produce some sort of HUB where we can neatly display the new articles [TIME, SITE, TITLE, etc....]. For the first few we'd probably just want to be able to input a discord webhook address where we'd be notified of changes instantly.
We're open to suggestions on what technology to use and how to go about this process.
We need the solution to
1. Be nearly instant 1-2 seconds til we're alerted
2. Have the ability to input our own rotating proxies
3. Webhooks integration that would allow us to send the new data to discord and eventually a more perfected hub.
Example sites would be theverge, nytimes, etc...
We're open to suggestions on what technology to use and how to go about this process.
We need the solution to
1. Be nearly instant 1-2 seconds til we're alerted
2. Have the ability to input our own rotating proxies
3. Webhooks integration that would allow us to send the new data to discord and eventually a more perfected hub.
Example sites would be theverge, nytimes, etc...