Create 2 crawlers for fetching data from website/google
Budget: $30 – $250 USD
We need 2 crawler which works on macos and windows - code language is your choice!
also you can use and customize existing crawler scripts - no problem, we just need working crawler
1st Crawler - Product Crawler
Searches within a specific page. A CSV file with article numbers is provided.
The crawler should then search the entire website for this article number and transfer certain values.
- article name
- Item description
- item picture
- Ingredients & Allergens (is a seperate tab on the page)
- Preparation & storage (is a separate tab on the page)
- Item details (is a separate tab on the page)
- Contact (is a separate tab on the page)
- Nutriscore (is a separate tab on the page)
These data should be written in the csv again
2nd Crawler - Lead Crawler
searches within google with predefined keyword after these criteria:
no SSL
Outdated Wordpress version
No responsive design
Website not indexable for Google
no privacy policy
Lack of privacy policy for contact forms
no cms
we need the url of the website if you meet at least 1 criterion. the output format does not matter to us.
also you can use and customize existing crawler scripts - no problem, we just need working crawler
1st Crawler - Product Crawler
Searches within a specific page. A CSV file with article numbers is provided.
The crawler should then search the entire website for this article number and transfer certain values.
- article name
- Item description
- item picture
- Ingredients & Allergens (is a seperate tab on the page)
- Preparation & storage (is a separate tab on the page)
- Item details (is a separate tab on the page)
- Contact (is a separate tab on the page)
- Nutriscore (is a separate tab on the page)
These data should be written in the csv again
2nd Crawler - Lead Crawler
searches within google with predefined keyword after these criteria:
no SSL
Outdated Wordpress version
No responsive design
Website not indexable for Google
no privacy policy
Lack of privacy policy for contact forms
no cms
we need the url of the website if you meet at least 1 criterion. the output format does not matter to us.
Related categories:
Business, Accounting, Human Resources & Legal
Python
Web Scraping
Software Architecture
JSON