Request for HDFS(Hadoop File System) Improvement
Budget: $250 – $750 USD
Current Issue)
An issue arises when HDFS processes more than 40 million throughput cases per minute
On Average, the process data from 16 different collectors are 100GB per minute
Current command we use to input CSV files to HDFS is ‘hdfs –put’
Question)
Whether it is possible to improve the system by changing the HDFS OPTION value?
Whether the number of throughput be increased if Hardware Spec on the Name Node Server is upgraded?
Whether there is another solution that can handle big data other than the HDFS system
Project Cost: 500$
Project Duration: 1 month
An issue arises when HDFS processes more than 40 million throughput cases per minute
On Average, the process data from 16 different collectors are 100GB per minute
Current command we use to input CSV files to HDFS is ‘hdfs –put’
Question)
Whether it is possible to improve the system by changing the HDFS OPTION value?
Whether the number of throughput be increased if Hardware Spec on the Name Node Server is upgraded?
Whether there is another solution that can handle big data other than the HDFS system
Project Cost: 500$
Project Duration: 1 month