Build a website that runs scripting in the background - data scraping
Budget: $15 – $65 USD
I am looking to have a subscription based website. The website will report prices for the users zipcode (throughout the US). The prices will update daily. The number of items listed on the site will be between 50-100. The price list for each zipcode will save weekly and be retrievable through a site search.
The price data will be scraped from three main websites. The data collected for each item will be Price and quantity. The data shown on the website will be the 50-100 items, zipcode, price, quantity, and company (the website the price was scraped from).
The user should be able to download the price list in Excel or CSV format.
I would prefer to not split the server, so it is just one server that is running the scripting and the website. The developer would also need to be aware of updates and workflow the websites that are being scraped and give me an estimate of the time it would take for you to respond if the integration breaks.
The price data will be scraped from three main websites. The data collected for each item will be Price and quantity. The data shown on the website will be the 50-100 items, zipcode, price, quantity, and company (the website the price was scraped from).
The user should be able to download the price list in Excel or CSV format.
I would prefer to not split the server, so it is just one server that is running the scripting and the website. The developer would also need to be aware of updates and workflow the websites that are being scraped and give me an estimate of the time it would take for you to respond if the integration breaks.