Crawl Google result and save to MongoDB with Python
Budget: $30 – $250 USD
I need to build one project crawl Google.
And save to MongoDB with Python
I need to use request and bs4 for crawl data, but I have a very difficult problem is Google block crawl. Has any way to anti detect or bypass that?
The input I need:
- Language (country) need to crawl. Like en = English, cn = China.
- Quality results need to crawl. If function input = ALL is crawl all result. If = number is quality result.
- Keywords to input crawl. I have a lot of keywords that need to crawl.
And the output is:
- Title
- Description
- URL
Please text for me the method for bypass Google anti detect crawl. I need to detail for decide that. Thank you so much. The method bypass Google block is very important. So please chat with me for detail about ways to do that.
And save to MongoDB with Python
I need to use request and bs4 for crawl data, but I have a very difficult problem is Google block crawl. Has any way to anti detect or bypass that?
The input I need:
- Language (country) need to crawl. Like en = English, cn = China.
- Quality results need to crawl. If function input = ALL is crawl all result. If = number is quality result.
- Keywords to input crawl. I have a lot of keywords that need to crawl.
And the output is:
- Title
- Description
- URL
Please text for me the method for bypass Google anti detect crawl. I need to detail for decide that. Thank you so much. The method bypass Google block is very important. So please chat with me for detail about ways to do that.