Create a search engine / fetcher to get specific data from some sites

Job ID: 34921192

Budget: $10 – $30 USD

Hello,
I want to use one open source search engine to populate a database with prices and presentations of all products of a list of specific websites.

For example, I have a list of sites, like plazavea.com.pe

I want the crawler to enter all the products in that page and all pages in the list I predifined, like this product page: https://www.plazavea.com.pe/leche-evaporada-gloria-light-paquete-6un-lata-400g/p
and get the name of the product, the brand, the price, the SKU and any other data from the product sheet present in that website.

Then I need ALL this information to be saved in a database, looking like this:
| website ID | website name | URL | product URL | Price | SKU | name of product | brand | any-other-field | date of data fetched |

I need all this data to be fetched daily, once per day, from all the sites in the predefined list.

I want this to be saved in a MySQL database and can be done with any open source search engine in Java, Javascript, Python or PHP

Locally we have more experience with PHP so that is preferred but not needed.

It will be hosted in an CENTOS server with Apache.

I don't want to program from ZERO a search engine. The requirement is specific to *use an existing open source search engine*

The service must include installation and testing.

Thanks!
Related categories: PHP Web Scraping MySQL Web Crawling Open Source