Program to scrape website data into SQL database
Budget: $30 – $250 USD
The website is a live updated website from a manufacturing machine. The data is updated on every refresh.
See attached image for the website (text only) page that we are discussing.
We need to be able to scrape the data once a minute and the data needed is highlighted so its the time stamp, and then 5 numbers. Each of these 6 items will be pushed into a SQL database across 6 different columns in one table.
We are also needing to figure out how to get a monthly total as the processed numbers zero out each time a job completes you have a job started and job ended time which could be a trigger for that but wanting to try and get a 7th column with the quantity ongoing so we can track efficiencies but also total throughput.
See attached image for the website (text only) page that we are discussing.
We need to be able to scrape the data once a minute and the data needed is highlighted so its the time stamp, and then 5 numbers. Each of these 6 items will be pushed into a SQL database across 6 different columns in one table.
We are also needing to figure out how to get a monthly total as the processed numbers zero out each time a job completes you have a job started and job ended time which could be a trigger for that but wanting to try and get a 7th column with the quantity ongoing so we can track efficiencies but also total throughput.