Data Analysis using Map/Reduce -- 2
Budget: $30 – $250 USD
One of the advantages of cloud computing is its ability to deal with very large data sets and still have a
reasonable response time. Typically, the map/reduce paradigm is used for these types of problems in
contrast to the RDBMS approach for storing, managing, and manipulating this data. An immediate
analysis of a large data set does not require designing a schema and loading the data set into an RDBMS.
Hadoop is a widely used open source map/reduce platform. Hadoop Map/Reduce is a software
framework for writing applications, which process vast amounts of data in parallel on large clusters. In
this project, you will use the IMDB (International Movies) dataset and develop programs to get
interesting insights into the dataset using Hadoop map/reduce paradigm. Please use the following links
for a better understanding of Hadoop and Map/Reduce
(https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/hadoop-mapreduce-clientcore/MapReduceTutorial.html)
detailed description of project is attached below
reasonable response time. Typically, the map/reduce paradigm is used for these types of problems in
contrast to the RDBMS approach for storing, managing, and manipulating this data. An immediate
analysis of a large data set does not require designing a schema and loading the data set into an RDBMS.
Hadoop is a widely used open source map/reduce platform. Hadoop Map/Reduce is a software
framework for writing applications, which process vast amounts of data in parallel on large clusters. In
this project, you will use the IMDB (International Movies) dataset and develop programs to get
interesting insights into the dataset using Hadoop map/reduce paradigm. Please use the following links
for a better understanding of Hadoop and Map/Reduce
(https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/hadoop-mapreduce-clientcore/MapReduceTutorial.html)
detailed description of project is attached below