Big Data Project
Budget: $30 – $250 USD
[This is an urgent project. Only bid if you can do it in 24 hours. I can pay $100(Slightly negotiable). Write "BIG DATA" at the start so that I know you read this.]
Details about the dataset will be provided in chat. You job is to:
--------------
Step 1:
---------------
Explore and study your allocated public dataset and provide:
1. A detailed overview of the dataset.
2. An appraisal of the quality of the dataset in terms of the integrity rules [Will share the integrity rules in chat].
3. A single question that you consider, if answered, will provide reasonable value along with an explanation of who you consider would benefit from this value and why they would benefit.
-------------
Task 2
--------------
Using your question, undertake the following work on your allocated dataset:
1. Use the Google BigQuery Console to create all the appropriate SQL statements required to enable you to answer your question.
2. Create a Google Colab notebook that executes your SQL statements using BigQuery and stores the results of your queries in Google Cloud Storage as CSV files.
3. Visualize the data contained in your CSV files, in a manner of your choosing, that you consider clearly communicates your findings and the value obtained.
-------------
Task 3
-------------
Complete the following steps to share the results of your queries, contained in your CSV files, using Cloud SQL:
1. Load your CSV files into a Google Cloud SQL database using an approach of your choosing.
2. Create appropriate SQL statements that can be used to query your Google Cloud SQL database to view your findings in tabular form.
--------------------------
Documentation
---------------------------
A report is required, documenting the work you undertook to complete each
task. Your report must include a headed section covering each task. All source code, both
Python and SQL, must be included directly in the report and not provided as a screen
capture only. Your code must be explained in detail in your narrative so that it is clear what
it does. If your code is based on examples, you have consulted, then you must make this
clear and explain any changes you have made to the code to meet your needs. Screen
captures included as supporting evidence of undertaking your work must also be explained
in detail in your narrative. Your report must be self-contained.
Details about the dataset will be provided in chat. You job is to:
--------------
Step 1:
---------------
Explore and study your allocated public dataset and provide:
1. A detailed overview of the dataset.
2. An appraisal of the quality of the dataset in terms of the integrity rules [Will share the integrity rules in chat].
3. A single question that you consider, if answered, will provide reasonable value along with an explanation of who you consider would benefit from this value and why they would benefit.
-------------
Task 2
--------------
Using your question, undertake the following work on your allocated dataset:
1. Use the Google BigQuery Console to create all the appropriate SQL statements required to enable you to answer your question.
2. Create a Google Colab notebook that executes your SQL statements using BigQuery and stores the results of your queries in Google Cloud Storage as CSV files.
3. Visualize the data contained in your CSV files, in a manner of your choosing, that you consider clearly communicates your findings and the value obtained.
-------------
Task 3
-------------
Complete the following steps to share the results of your queries, contained in your CSV files, using Cloud SQL:
1. Load your CSV files into a Google Cloud SQL database using an approach of your choosing.
2. Create appropriate SQL statements that can be used to query your Google Cloud SQL database to view your findings in tabular form.
--------------------------
Documentation
---------------------------
A report is required, documenting the work you undertook to complete each
task. Your report must include a headed section covering each task. All source code, both
Python and SQL, must be included directly in the report and not provided as a screen
capture only. Your code must be explained in detail in your narrative so that it is clear what
it does. If your code is based on examples, you have consulted, then you must make this
clear and explain any changes you have made to the code to meet your needs. Screen
captures included as supporting evidence of undertaking your work must also be explained
in detail in your narrative. Your report must be self-contained.