云计算下MapReduce多组容错机制架构的分析与研究
Analysis and Study on under Cloud Computing Multiple Sets of Fault Tolerance Strategy Architecture of MapReduce
-
摘要: 提出了MapReduce多组容错机制，在传统的Hadoop MapReduce架构上进行改进，即在同机柜中的Task-T racker节点之间增加了多组关系，这样可以缩短发现失效节点的时间，同时减轻JobT racker节点的负荷，减低了带宽使用率，减少网络拥塞.通过实验证明，M apReduce多组容错机制提高了M apReduce的工作效率.Abstract: This paper presents a Multiple Sets of Fault Tolerance Strategy of MapReduce,improve Hadoop MapReduce framework,between TaskTracker node in the same cabinet group relationship added multiple sets relations,it can short the time of founding the failed node,at the same time,reduce the load of JobTracker node,bandwidth utilization and network congestion.The experimental results show that Multiple Sets of Fault Tolerance Strategy of MapReduce improved the efficiency of MapReduce.
下载:
