黄强. 发布/订阅系统中的历史数据分布式存储算法[J]. 微电子学与计算机, 2014, 31(9): 138-142.
引用本文: 黄强. 发布/订阅系统中的历史数据分布式存储算法[J]. 微电子学与计算机, 2014, 31(9): 138-142.
HUANG Qiang. The Historic Data Distributed Storage Algorithm in Publish/Subscribe System[J]. Microelectronics & Computer, 2014, 31(9): 138-142.
Citation: HUANG Qiang. The Historic Data Distributed Storage Algorithm in Publish/Subscribe System[J]. Microelectronics & Computer, 2014, 31(9): 138-142.

发布/订阅系统中的历史数据分布式存储算法

The Historic Data Distributed Storage Algorithm in Publish/Subscribe System

  • 摘要: 在分析当前发布/订阅系统在历史数据存储方面相关工作的基础上,提出了一种利用系统中的存储代理对历史数据进行分布式存储的算法.算法将存储代理组成覆盖网,利用一致性哈希定位主题元数据位置,主题数据分段存储在存储设备上,并采用文件索引、并行读取等方法来提高数据存取性能.在对比实验中,验证了算法在负载均衡和扩展性方面的优势.

     

    Abstract: Based on the summarization of current research work on historic data storage in P/S systems,the paper presents a distributed algorithm to store historic data in P/S systems by proxies.The proxies are organized to form an overlay network.Cconsistent hashing is used to locate metadata agent,and topic data are stored by segments.Topic file indexing,parallel reading and other methods are applied in order to improve the performance.In comparative experiments,the proposed algorithm outperforms in load balancing and scalability.

     

/

返回文章
返回