Webscraper Version 1 - option for long term partnership
Budget: €30 – €250 EUR
First Version Requirements:
The Script has to run on an MacBook Pro (processor: 2,5 GHz Quad-Core Intel Core i7 | RAM: 16 GB 1600 MHz DDR3)
1. daily scrape:
go through all listings once a day.
2. update database
If any changes are detected, the corresponding advertisement must be updated in the database. The price history must not be lost. If an already scraped advertisement is no longer available, the entry: 'sold' is added to the database entry.
3. blocking safe
The website blocks after 20 requests. So it must be taken into account that the site quickly punishes with restrictions.
4. CSV export
A clean export is expected or store it in MongoDB
The required information i need from the page can be found in the HTML appendix.
If we are happy with the Version we will discuss any further details of the project.
The Script has to run on an MacBook Pro (processor: 2,5 GHz Quad-Core Intel Core i7 | RAM: 16 GB 1600 MHz DDR3)
1. daily scrape:
go through all listings once a day.
2. update database
If any changes are detected, the corresponding advertisement must be updated in the database. The price history must not be lost. If an already scraped advertisement is no longer available, the entry: 'sold' is added to the database entry.
3. blocking safe
The website blocks after 20 requests. So it must be taken into account that the site quickly punishes with restrictions.
4. CSV export
A clean export is expected or store it in MongoDB
The required information i need from the page can be found in the HTML appendix.
If we are happy with the Version we will discuss any further details of the project.