Google Spreadsheet Data Processing & Google Search API 5000 records
Budget: $250 – $750 USD
I am looking for a freelancer who can assist me with processing data in a Google Spreadsheet using the Google Search API.
Specific tasks that need to be done include:
- Data searching
- Data cleaning and formatting
- Data merging and consolidation
I have specific requirements and preferences for the data processing tasks, and I would like the freelancer to use specific tools or methods to achieve the desired results.
If you have experience with Google Spreadsheet data processing and regularly work with the Google Search API, please review the following project requirements:
You will be provided with a google doc spreadsheet with 5000 records
Using the google doc API, https://developers.google.com/docs/api/how-tos/overview
you will read records out of this google spreadsheet
Then Using the google search API developer stack
https://developers.google.com/custom-search/v1/overview
You will concatenate the names of organizations into four separate search strings that you will query google with, using data out of the google spreadsheet
google query string: "Organization name + Organization city + Organization state + keyword"
There will be four keywords that google will be queried for, per record.
Starting with 5000 records x 4 keywords, that will result in 20,000 google API search requests
You will save the data from the original google doc along with the keyword, resulting description resulting URL for the first three results from the google API, which will result in 60,000 record results from the original 20,000 keyword requests.
You will add these records into a new google doc spreadsheet as they come in, filtering the text for content that matches the original query text to eliminate irrelevant and duplicate records.
You will be provided a google doc from which records will be loaded by API, and you will be provided with a google doc into which resulting search results will be placed using the google doc API
https://developers.google.com/docs/api/how-tos/overview
-----
If you're able to find the needle of a date inside the haystack of the content in the resulting URL and save a formatted date in the google doc, that would be excellent.
For example
https://www.google.com/search?q=the+academy+awards+2023
results in a date that shows up either in the search title or the URL
The first result URL is this: https://www.oscars.org/oscars/ceremonies/2023 and the date of the event would be "Sunday, March 12, 2023"
The formatted date that we would want you to save to the google doc would be "March 12, 2023" along with the search results:
Specific tasks that need to be done include:
- Data searching
- Data cleaning and formatting
- Data merging and consolidation
I have specific requirements and preferences for the data processing tasks, and I would like the freelancer to use specific tools or methods to achieve the desired results.
If you have experience with Google Spreadsheet data processing and regularly work with the Google Search API, please review the following project requirements:
You will be provided with a google doc spreadsheet with 5000 records
Using the google doc API, https://developers.google.com/docs/api/how-tos/overview
you will read records out of this google spreadsheet
Then Using the google search API developer stack
https://developers.google.com/custom-search/v1/overview
You will concatenate the names of organizations into four separate search strings that you will query google with, using data out of the google spreadsheet
google query string: "Organization name + Organization city + Organization state + keyword"
There will be four keywords that google will be queried for, per record.
Starting with 5000 records x 4 keywords, that will result in 20,000 google API search requests
You will save the data from the original google doc along with the keyword, resulting description resulting URL for the first three results from the google API, which will result in 60,000 record results from the original 20,000 keyword requests.
You will add these records into a new google doc spreadsheet as they come in, filtering the text for content that matches the original query text to eliminate irrelevant and duplicate records.
You will be provided a google doc from which records will be loaded by API, and you will be provided with a google doc into which resulting search results will be placed using the google doc API
https://developers.google.com/docs/api/how-tos/overview
-----
If you're able to find the needle of a date inside the haystack of the content in the resulting URL and save a formatted date in the google doc, that would be excellent.
For example
https://www.google.com/search?q=the+academy+awards+2023
results in a date that shows up either in the search title or the URL
The first result URL is this: https://www.oscars.org/oscars/ceremonies/2023 and the date of the event would be "Sunday, March 12, 2023"
The formatted date that we would want you to save to the google doc would be "March 12, 2023" along with the search results: