Amazon web scraping
Budget: $250 – $750 USD
A Senior Developer with knowledge of python is required - web Scrapping, aws and non-relational databases. for short project. payment at the end of developments.
MVP – web scrapping Amazon.
As a company business we would like to extract some product information from Amazon website and it has to be storage at DB cloud
Acceptance criteria.
1. It is vital to establish the Cloud AWS viability and it's set up.
2. It is mandatory to begin with root products by category.
a.We need a collection by category,
b.Subcategories: Create different DB inside the same collection.
c.We need scan only prime products using a VPN (Geo tag USA).
d.Any new product has to create a new register in the DB
2.Data:
a.Product URL.
b.Products Name.
c.At least 6 pictures from each products, URL is mandatory
d.TAG price USD.
e.Product Category.
f.Main Product information.
g.General Specification.
h.Product Detail.
i.ETA delivery (delivery time).
j.Product Scan date time .
3.Data Base.
a.Create a individual SKU for each product.
b.That SKU has to be searchable inside the data base.
4.The whole process can be re-launch at any time.
MVP – Job Process.
The DB can update and keep any change on record.
1.Job Update.
a.Daily.
b.DB has to keep recorded the last uptade in specif data field.
c.Update scanned products.
d.Scan new products assigning a consecutive SKU.
e.Update DB adding a new field if the product was update (price, qty, etc).
f.After running any update any product(s) is missing the DB has to create a data filed called 'out of stock''.
MVP – web scrapping Amazon.
As a company business we would like to extract some product information from Amazon website and it has to be storage at DB cloud
Acceptance criteria.
1. It is vital to establish the Cloud AWS viability and it's set up.
2. It is mandatory to begin with root products by category.
a.We need a collection by category,
b.Subcategories: Create different DB inside the same collection.
c.We need scan only prime products using a VPN (Geo tag USA).
d.Any new product has to create a new register in the DB
2.Data:
a.Product URL.
b.Products Name.
c.At least 6 pictures from each products, URL is mandatory
d.TAG price USD.
e.Product Category.
f.Main Product information.
g.General Specification.
h.Product Detail.
i.ETA delivery (delivery time).
j.Product Scan date time .
3.Data Base.
a.Create a individual SKU for each product.
b.That SKU has to be searchable inside the data base.
4.The whole process can be re-launch at any time.
MVP – Job Process.
The DB can update and keep any change on record.
1.Job Update.
a.Daily.
b.DB has to keep recorded the last uptade in specif data field.
c.Update scanned products.
d.Scan new products assigning a consecutive SKU.
e.Update DB adding a new field if the product was update (price, qty, etc).
f.After running any update any product(s) is missing the DB has to create a data filed called 'out of stock''.