WEBSCRAPING OF RETAILER SITE
Budget: $30 – $250 USD
We need a webscraper that will scrape https://www.optimera.se/ that is a Swedish building material website in Sweidsh.
We need a scrape that will find all public products and their associated prices for their different price type such as price per piece or weight.
The program should be in a .net core or .net standard libary.
It’s important that the number of simultaius page scrapes can be adjusted to the computer capsity of running it. The program should store data in a json after collecting it until ready to sent it. The program should also be able to handle some inturaptions like ”network down” or ”site not responding”. It should also be able to handle crasches of computer and be able to restart from last checkpoint.
The products needs following:
- Name – string
- Articlenumber - string
The associated prices that needs to be find:
- Gross price - decimal
- Price type that should match enum - enum
- Timestamp of when the price was read – long
If the price would be 0 of any article the price should be ignored. We still need the article but not the price of it. The price should be without VAT.
We need a scrape that will find all public products and their associated prices for their different price type such as price per piece or weight.
The program should be in a .net core or .net standard libary.
It’s important that the number of simultaius page scrapes can be adjusted to the computer capsity of running it. The program should store data in a json after collecting it until ready to sent it. The program should also be able to handle some inturaptions like ”network down” or ”site not responding”. It should also be able to handle crasches of computer and be able to restart from last checkpoint.
The products needs following:
- Name – string
- Articlenumber - string
The associated prices that needs to be find:
- Gross price - decimal
- Price type that should match enum - enum
- Timestamp of when the price was read – long
If the price would be 0 of any article the price should be ignored. We still need the article but not the price of it. The price should be without VAT.