Straggler mitigation in Hadoop Mapreduce framework
Budget: $30 – $250 USD
1. Implement the straggler solution using the approach below
a) Develop a method to detect slow tasks (stragglers) in the Hadoop MapReduce
framework using Progress Score (PS), Progress Rate (PR) and Remaining Time
(RT) metrics
b) Develop a method of selecting idle nodes to replicate detected slow tasks using
the CPU time and Memory Status (MS) of the idle nodes.
c) Develop a method for scheduling the slow tasks to appropriate idle nodes using
CPU time and Memory Status of the idle nodes.
2. A good report on the implementation with graphics
3. A recorded execution process
Use any certified data to test the efficiency of the methods
a) Develop a method to detect slow tasks (stragglers) in the Hadoop MapReduce
framework using Progress Score (PS), Progress Rate (PR) and Remaining Time
(RT) metrics
b) Develop a method of selecting idle nodes to replicate detected slow tasks using
the CPU time and Memory Status (MS) of the idle nodes.
c) Develop a method for scheduling the slow tasks to appropriate idle nodes using
CPU time and Memory Status of the idle nodes.
2. A good report on the implementation with graphics
3. A recorded execution process
Use any certified data to test the efficiency of the methods
Related categories:
Business, Accounting, Human Resources & Legal
C++ Programming
Big Data Sales
Hadoop
Map Reduce