Data Collection & Preparation - Python Assignment
Budget: €30 – €250 EUR
Overview:
The objective of this assignment is to collect a dataset from a public web API and then use Python to prepare, analyse, and derive insights from the collected data.
The assignment should be implemented as two Jupyter Notebooks (not script files). Your notebooks should be clearly documented, using comments and Markdown cells to explain the code and interpret the results of your analysis.
Tasks:
Complete the following tasks in two separate notebooks:
1. Data Identification & Collection:
a. Choose one of the APIs from the list of web APIs provided at the link below:
http://mlg.ucd.ie/modules/COMP41680/api-list.html
Note that, depending on the choice of API, you might need to repeat the collection process multiple times to download sufficient data for analysis.
Save the collected dataset in an appropriate format for subsequent analysis.
2. Data preparation and analysis:
a. Load the saved dataset from Task 1 into an appropriate data structure.
Apply any preprocessing steps that might be required to clean, filter or transform the dataset before analysis.
Analyse, characterise, and summarise the cleaned dataset, using tables and visualisations where appropriate. Clearly explain each step of this process and interpret the results which are produced. Markdown cells should be used for the explanations and interpretations.
At the end of your notebook, summarise any insights which you gained from your analysis of the data, discuss the challenges faced in collecting data from the API, and suggest ideas for further analysis which could be performed on the data.
The objective of this assignment is to collect a dataset from a public web API and then use Python to prepare, analyse, and derive insights from the collected data.
The assignment should be implemented as two Jupyter Notebooks (not script files). Your notebooks should be clearly documented, using comments and Markdown cells to explain the code and interpret the results of your analysis.
Tasks:
Complete the following tasks in two separate notebooks:
1. Data Identification & Collection:
a. Choose one of the APIs from the list of web APIs provided at the link below:
http://mlg.ucd.ie/modules/COMP41680/api-list.html
Note that, depending on the choice of API, you might need to repeat the collection process multiple times to download sufficient data for analysis.
Save the collected dataset in an appropriate format for subsequent analysis.
2. Data preparation and analysis:
a. Load the saved dataset from Task 1 into an appropriate data structure.
Apply any preprocessing steps that might be required to clean, filter or transform the dataset before analysis.
Analyse, characterise, and summarise the cleaned dataset, using tables and visualisations where appropriate. Clearly explain each step of this process and interpret the results which are produced. Markdown cells should be used for the explanations and interpretations.
At the end of your notebook, summarise any insights which you gained from your analysis of the data, discuss the challenges faced in collecting data from the API, and suggest ideas for further analysis which could be performed on the data.