Make.com Google Search to Google Sheets Automation
Budget: $10 – $30 USD
I'm seeking an expert in Make.com who can automate the extraction of Google search results into Google Sheets. Next to each url column should be the date column. This is NOT the date of publication but the date of the extraction. So all urls pulled on a certain day will have the same date.
Key Details:
I need to create a Make.com scenario where a google search result will populate a googlesheet page with urls from the search results. This scenario will be run weekly based upon a predefined google search, The search will be divided into 10 pages with 10 search results per page. Each page will need to be run sequentially to capture all urls. However, there many be less than 100 results so your scenario will need to identify when to stop based the results of the google search.
ou will need to use a Text parser module to clean the links. The results page should note include any of the internal google links and should only include the search results.
The coding for Google will require cleaning since the href results in a format similar to "/url?q=https://www.cnn.com&ved=2ahUKEwjNyNv9z7mJweweEFkFHUpsEK8QFnoECAQQAg&usg=AOvVaw0sZzgvVDmj6zWGl5UbI8ZT
";"
This is a straight forward web scrape so it should not take long.
However, please only respond if you have experience with Make.com automation and google search.
Ideal Skills and Experience:
- Proficiency with Make.com.
- Experience in automating Google search results extraction.
- Familiarity with Google Sheets.
- Ability to set up and manage filters and predefined search parameters.
- Experience in error handling and debugging within automation workflows.
- Expertise in data cleaning and transformation techniques.
You will need to use your own Make.com account (free). Your finished scenario will need to be saved in your account and then exported so I can import it into my account.
Example Search: (note this is not the actual search and we will need to modify this after completed delivery)
PAGE 1
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=0
PAGE 2
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=10
PAGE 3
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=20
PAGE 4
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=30
PAGE 5
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=40
PAGE 6
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=50
PAGE 7
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=60
PAGE 8
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=70
PAGE 9
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=80
PAGE 10
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=90
Y
Key Details:
I need to create a Make.com scenario where a google search result will populate a googlesheet page with urls from the search results. This scenario will be run weekly based upon a predefined google search, The search will be divided into 10 pages with 10 search results per page. Each page will need to be run sequentially to capture all urls. However, there many be less than 100 results so your scenario will need to identify when to stop based the results of the google search.
ou will need to use a Text parser module to clean the links. The results page should note include any of the internal google links and should only include the search results.
The coding for Google will require cleaning since the href results in a format similar to "/url?q=https://www.cnn.com&ved=2ahUKEwjNyNv9z7mJweweEFkFHUpsEK8QFnoECAQQAg&usg=AOvVaw0sZzgvVDmj6zWGl5UbI8ZT
";"
This is a straight forward web scrape so it should not take long.
However, please only respond if you have experience with Make.com automation and google search.
Ideal Skills and Experience:
- Proficiency with Make.com.
- Experience in automating Google search results extraction.
- Familiarity with Google Sheets.
- Ability to set up and manage filters and predefined search parameters.
- Experience in error handling and debugging within automation workflows.
- Expertise in data cleaning and transformation techniques.
You will need to use your own Make.com account (free). Your finished scenario will need to be saved in your account and then exported so I can import it into my account.
Example Search: (note this is not the actual search and we will need to modify this after completed delivery)
PAGE 1
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=0
PAGE 2
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=10
PAGE 3
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=20
PAGE 4
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=30
PAGE 5
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=40
PAGE 6
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=50
PAGE 7
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=60
PAGE 8
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=70
PAGE 9
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=80
PAGE 10
https://www.google.com/search?q=earthquake&num=10&lr=&cr=countryUS&sca_esv=29cde2af3c8132ef&tbs=ctr:countryUS,qdr:w&sxsrf=ADLYWIKd7TwxgHniSMMyYpVdSErxA1TT0w:1730500351497&ei=_1YlZ_H5Hcep5NoPyaKN8Ao&start=0&sa=N&ved=2ahUKEwix9e-VmLyJAxXHFFkFHUlRA644ChDy0wN6BAgJEAQ&biw=1920&bih=991&dpr=1&num=10&start=90
Y