Build Data Scraper - laravel - puppeteer - nodejs - mysql-python

Job ID: 33104151

Budget: $250 – $750 AUD

Hi,
I am interested in a professional developer with experience in building online data scrapers using:
We need 5 data scrapers build for 5 different websites to start with.

The project aims to build a few complete scraper preferable by the same person so there is consistency over the code.

Preferred knowledge
- puppeteer
- scrapy
- elasticsearch
- beautiful soup
- mysql
- nodejs
- vuejs
- python
- larvael

If you never build a scraper before please do not bid.


The project aims to build a few complete scraper preferable by the same person so there is consistency over the code.

The scraper will scrape a webpage with dynamic select boxes data and save the information in a specific json structure.
The scraper should be smart enough if rolled out at a later date to check if new data is available and to update the database accordingly.


At the end of the project a full code export is expected which can be run on a separate PC ( Ubuntu ), the PC will be provided where the data scraper can be run from.

More information will be provided to the selected applicants.
Related categories: Python Web Scraping Elasticsearch