Google Index + HTTP Status python script
Budget: $30 – $250 AUD
I already have a script written, but up to you.
Need to:
1. Collect over 100,000 URLS from mongo db (script already written).
2. Check if each of the URLs exists or not in Google.
3. Check and report HTTP status of each website.
4. Update mongo db.
Will need proxies to stop 429 too many requests issues.
Tool designed to tell clients if their URLs are live and indexed.
Urgent deadline.
More details:
What is the main goal of the script? To monitor changes in Google indexing
Do you have a preferred programming language for the script? Python
What specific data do you want to track for Google indexing changes? If URL exists or not
Need to:
1. Collect over 100,000 URLS from mongo db (script already written).
2. Check if each of the URLs exists or not in Google.
3. Check and report HTTP status of each website.
4. Update mongo db.
Will need proxies to stop 429 too many requests issues.
Tool designed to tell clients if their URLs are live and indexed.
Urgent deadline.
More details:
What is the main goal of the script? To monitor changes in Google indexing
Do you have a preferred programming language for the script? Python
What specific data do you want to track for Google indexing changes? If URL exists or not