Create a RESTful API to scraping some website and list price for same product
Budget: $30 – $250 USD
I need to have a RESTful API to scraping some websites and find prices for same product.
I can give you some sample.
First of all, you should tell me how you will find same product in different websites and how you will make sure that product is same with product in other website.
All websites you need to scrap located in US.
As a reference:
We have Amazon, Walmart, Costco, Target.
this API find a product in Amazon (Coca-Cola 1.5 lt Sugar Free).
now, API should looking for this product in Walmart, Costco, and Target as well.
when same product found in other online shopping websites, API should save the product name and all prices in MongoDB collection.
Names and Prices of the product in all scraped websites should save in MongoDB.
All image addresses of product in all website should store in MongoDB collection separated by website name.
For example related to above line: we have four online shopping websites.
scraped product has five images in every online shopping websites.
in this case we need to save 20 image address in MongoDB.
every photo should have an attribute (in MongoDB) to define the online shopping website that image belongs to.
this web app should scrap the whole website and do same job for all products.
this task should run every hour.
re-launch period can define as hard-coded during development.
main website that you need to start finding a product from, is Amazon.
we can define the product category of Amazon during development as hard-coded to avoid crawling whole website.
BEFORE ANY ADVERTISEMENT AND SENDING AUTOMATIC BIDS, READ PROJECT DETAILS AND TELL ME HOW YOU WANT TO DO THIS JOB ?
HOW YOU WANT TO MAKE SURE OF FINDING SAME PRODUCT IN DIFFERENT WEBSITES ?
***DON'T TRY TO CHEAT ME***
I can give you some sample.
First of all, you should tell me how you will find same product in different websites and how you will make sure that product is same with product in other website.
All websites you need to scrap located in US.
As a reference:
We have Amazon, Walmart, Costco, Target.
this API find a product in Amazon (Coca-Cola 1.5 lt Sugar Free).
now, API should looking for this product in Walmart, Costco, and Target as well.
when same product found in other online shopping websites, API should save the product name and all prices in MongoDB collection.
Names and Prices of the product in all scraped websites should save in MongoDB.
All image addresses of product in all website should store in MongoDB collection separated by website name.
For example related to above line: we have four online shopping websites.
scraped product has five images in every online shopping websites.
in this case we need to save 20 image address in MongoDB.
every photo should have an attribute (in MongoDB) to define the online shopping website that image belongs to.
this web app should scrap the whole website and do same job for all products.
this task should run every hour.
re-launch period can define as hard-coded during development.
main website that you need to start finding a product from, is Amazon.
we can define the product category of Amazon during development as hard-coded to avoid crawling whole website.
BEFORE ANY ADVERTISEMENT AND SENDING AUTOMATIC BIDS, READ PROJECT DETAILS AND TELL ME HOW YOU WANT TO DO THIS JOB ?
HOW YOU WANT TO MAKE SURE OF FINDING SAME PRODUCT IN DIFFERENT WEBSITES ?
***DON'T TRY TO CHEAT ME***