改进的云存储系统数据分布策略

被引:27
作者
周敬利
周正达
机构
[1] 华中科技大学计算机科学与技术学院
关键词
云存储; 一致性哈希; 数据分布; 虚拟化; 负载均衡;
D O I
暂无
中图分类号
TP333 [存贮器];
学科分类号
081201 ;
摘要
针对当前云存储系统海量数据应用环境中数据分布策略可扩展性以及灵活性的不足,提出一种高效的数据分布策略。一方面,该策略基于一致性哈希数据分布算法,引入了虚拟化的设计思路,采用虚拟节点进行存储资源分配;另一方面,该策略采用了一种基于节点容量感知的负载均衡方法,有效地优化了系统性能,提高了系统可扩展性。通过实验分析,不管在同构还是异构的云存储架构中,该策略改善了存储资源负载均衡程度,有效优化了系统整体性能。
引用
收藏
页码:309 / 312
页数:4
相关论文
共 13 条
[1]  
W. Litwin,,M. A. Neimat,D. A. Schneider.LH*: a scalable, distributed data structure. ACM Transactions on Database Systems . 1996
[2]  
Giuseppe DeCandia,Deniz Hastorun,Madan Jampani,et al.Dynamo:Amazon‘s Highly Available Key-value store. Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles . 2007
[3]  
BORTHAKU D.The Hadoop distributed file system:Architectureand design. http://hadoop.apache.org/common/docs/r0.18.0/hdfs_design.pdf . 2011
[4]  
Amazon Web Services.Amazon Simple Storage Service(Amazon S3). http://aws.amazon.com .
[5]  
Hbase Development Team.HBase:Bigtable-like structured storagefor Hadoop HDFS. http://wiki.a-pache.org/hadoop/Hbase . 2011
[6]  
Schmuck F,Haskin R.GPFS: A Shared-Disk File System for Large Computing Clusters. Proceedings of the Conference on File and Storage Technologies (FAST’02) . 2002
[7]  
LEWIN,D.Consistent hashing and random trees: Algorithms caching in distributed networks. . 1998
[8]  
ZENG WENYING,ZHAO YUELONG,OU KAIRI,et al.Researchon cloud storage architecture and key technologies. ICIS’’’’09:Proceedings of the 2nd International Conference on Interaction Sci-ences:Information Technology,Culture and Human . 2009
[9]  
Secure Hash standard[S/OL]. FIPS180-1 . 2011
[10]  
PATIL S,GIBSON G.Scale and concurrency of GIGA+:Filesystem directories with millions of files. FAST’’’’11:Proceed-ings of the 9th USENIX Conference on File and Storage Technolo-gy . 2011