google url scrapper

Job ID: 36408988

Budget: $30 – $250 USD

google search enginer
1- fill all requests simulating the maximum of real navigation to avoid robots
2- requests ip rotator
3- only pagination to page 5 if any
4- put a variable to define the domains to not be saved in the file url output
5- use the cli method python3 google.py wordlist.txt outputurls.txt

output.txt - save domains in format

www.site.com
subdomain.com

remembering to ignore domains containing the words in the variable
example word contain remove domain: youtube, amazom, wikipedia, instagram ....