陈运海, 陈正亮, 王钦辉, 叶保留. Cumulus:一个基于网络编码的分布式文件系统[J]. 微电子学与计算机, 2012, 29(9): 74-78.
引用本文: 陈运海, 陈正亮, 王钦辉, 叶保留. Cumulus:一个基于网络编码的分布式文件系统[J]. 微电子学与计算机, 2012, 29(9): 74-78.
CHEN Yun-hai, CHEN Zheng-liang, WANG Qin-hui, YE Bao-liu. Cumulus: A Distributed File System Based on Network Coding[J]. Microelectronics & Computer, 2012, 29(9): 74-78.
Citation: CHEN Yun-hai, CHEN Zheng-liang, WANG Qin-hui, YE Bao-liu. Cumulus: A Distributed File System Based on Network Coding[J]. Microelectronics & Computer, 2012, 29(9): 74-78.

Cumulus:一个基于网络编码的分布式文件系统

Cumulus: A Distributed File System Based on Network Coding

  • 摘要: 基于网络编码在并发式数据传输时能够有效地降低网络负载的优越性,应用网络编码优化分布式文件系统的容错问题得到了广泛的关注.为了研究网络编码在分布式文件系统中的应用及其在降低网络负载的有效性,文中基于开源的Hadoop项目设计并实现了面向网络编码的分布式文件系统.该系统通过对存储文件进行切分,然后将这些文件切片进行编码存储,能够以更小的冗余开销获得更好的容错性能,同时,能够利用网络编码的性能提高网络资源利用率.

     

    Abstract: Network coding can reduce network load in the process of concurrent data transmission, which attracts much attention on the application of network coding to optimize the fault-tolerance of distributed file system.Based on Hadoop, an open source project, we design and implement a network coding oriented distributed file system to research the application of network coding in distributed file system and its effectiveness in reducing network load.By segmenting storage files and encoding, storing the file slices, the system is able to achieve a better fault tolerance with less redundancy overhead.Meanwhile, network resource utilization can be improved by taking advantage of network coding performance.

     

/

返回文章
返回