Website Scanning Script
Budget: $30 – $250 USD
I have an excel file with around 30k websites, some of which are no longer active. Would like a script created that can scan the entire list & detect which are inactive.
Scenarios may include:
— error / dns message
— 404 not found
— 'this site can’t be reached'
— redirect to domain registar
— domain is for sale page
In some cases the redirect can be a new company url, so it would be helpful if we captured redirects as output where I could then review afterwards.
This script should be something that I can run more than once, ideally hosted in the cloud with a platform such as digital ocean… but I’m open to suggestions.
thank you
Scenarios may include:
— error / dns message
— 404 not found
— 'this site can’t be reached'
— redirect to domain registar
— domain is for sale page
In some cases the redirect can be a new company url, so it would be helpful if we captured redirects as output where I could then review afterwards.
This script should be something that I can run more than once, ideally hosted in the cloud with a platform such as digital ocean… but I’m open to suggestions.
thank you