Website Scraping

Job ID: 37838355

Budget: €250 – €750 EUR

We need an entire domain to be scraped. The domain has around 1 million links. The domain is well protected by CloudFlare. You can do this manually or automatically.

I need every single site belonging to the domain to be saved fully in html alongside its resources (JavaScript, images). You should also download any CSVs, Excel files, Word files, or PDFs in the domain.

This should be seriously completed, within a few days. We are looking for competitive people. You will need to provide a sample of 100 pages before assigning the project to you.
Related categories: PHP JavaScript CSS Web Scraping HTML