大规模云存储系统副本布局研究

被引:6
作者
董继光
陈卫卫
田浪军
吴海佳
机构
[1] 解放军理工大学指挥自动化学院
关键词
云存储; 副本布局; 一致性哈希算法; 分组; 可靠性;
D O I
暂无
中图分类号
TP333 [存贮器];
学科分类号
081201 ;
摘要
在基于副本冗余机制的大规模云存储系统中,以往的副本布局算法只能部分地满足副本布局中高可靠、高可扩展并且高效的要求,针对这一问题,提出了一种基于分组和一致性哈希的副本布局算法。首先,将关联性高的存储节点进行分组;然后,通过改进的一致性哈希算法将同一数据对象的多个副本分别分配到不同分组中;最后,再通过改进的一致性哈希算法将分配到各分组的数据副本放置在组内对应的存储节点上。理论分析可知,该方法大大提高数据的可靠性。仿真结果表明,该算法能满足副本布局的均衡性、自适应性要求,并能在几十微秒内完成副本定位。
引用
收藏
页码:620 / 624
页数:5
相关论文
共 10 条
[1]  
David Karger,Eric Lehman,Tom Leighton,et al.Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the World Wide Web. Proceedings of the 29th Annual ACM Symposium on Theory of Computing . 1997
[2]  
Giuseppe DeCandia,Deniz Hastorun,Madan Jampani,et al.Dynamo:Amazon‘s Highly Available Key-value store. Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles . 2007
[3]  
GRAY J.What next?A few remaining problems in information tech-nology. http://research.microsoft.com/-gray/talks/Gray_Turing_FCRC.pdf . 2011
[4]  
WEIL S A,BRANDT S A,MILLER E L,et al.Ceph:A scalable,high-performance distributed file system. http://www.ssrc.ucsc.edu/Papers/weil-osdi06.pdf . 2010
[5]  
XIAO N,CHEN T.RAEDP:An effective hybrid data placement al-gorithm for large-scale storage systems. Journal of Supercomput-ing . 2011
[6]  
Shvachko K,Huang H,Radia S,Chansler R.The Hadoop distributed file system. Proc. the 26th IEEE (MSST2010) Symposium on Massive Storage Systems and Technologies (Research Track) . 2010
[7]  
Brinkmann,S Effert,F.Meyer auf der Heide,C.Scheideler.Dynamic and Redundant Data Placement. Proc.of the 27thInternational Conference on Distributed Computing Systems(ICDCS’07) . 2007
[8]  
Honicky RJ,Miller EL.Replication under scalable hashing:A family of algorithms for scalable decentralized data distribution. Proc.of the 18th Int’l Parallel&Distributed Processing Symp.(IPDPS 2004) . 2004
[9]  
Weil S A,Brandt S A,et al.Grid resource management-CRUSH:controlled,scalable,decentralized placement of replica-ted data. Proceedings of the 2006 ACM/IEEE confe-rence on High Performance Networking and Computing . 2006
[10]  
S.Ghemawat,H.Gobioff,S.Leung.The Google file system. Proceedings of the nineteenth ACM symposium on Operating systems principles . 2003