Complex web crawling/ web automation! -- 2

Job ID: 32012740

Budget: €8 – €30 EUR

For our platform, a car marketplace https://au2mobile.com/ we scrape car data (ads) from different dealer websites (original websites). Some of these scraped ads are not UpToDate (unclean) and should be removed from our database because they are sold/removed from the original website.
We need an “on time” solution, which removes the unclean ads from our database.
Some of these original websites have over 1 million cars and use different crawling limitations (like Proxy limitations. Pagination limitation etc.)

Plz, share with us your method, how you want to help us. Then we cannot answer every bid (mostly even did not read the description). So, share with us as much specific info as possible, that we get the idea, you are the one for this project.
We are doing complex web crawling and web automation. We create costume tools and need advanced and creative developers/teams with rich experience in this field.

We love, what we do, have to do for the next 3 years, and searching for long-term cooperation. Hope you are the one or the company, who can join our team, enjoy with us and grow with us in a promising project.
Related categories: Python Web Scraping Deep Learning