Towards optimisation of replicated erasure codes for efficient cooperative repair in cloud storage systems

被引:3
|
作者
Xu, Guangping [1 ]
Mao, Qunfang [1 ]
Li, Huan [1 ]
Li, Shengli [2 ]
机构
[1] Tianjin Univ Technol, Sch Comp & Commun Engn, Tianjin Key Lab Intelligence Comp & New Software, Tianjin 300384, Peoples R China
[2] Tianjin IC Card Publ Network Syst Co Ltd, Tianjin 300384, Peoples R China
基金
美国国家科学基金会;
关键词
erasure codes; distributed storage systems; data recovery; repair-efficient codes;
D O I
10.1504/IJCSE.2018.090444
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The study of erasure codes in distributed storage systems has two aspects: one is to reduce the data redundancy and the other one is to save the bandwidth cost during repair process. Repair-efficient codes are investigated to improve the repair performance. However the researches are mostly in theoretical stage and hardly applied in the practical distributed storage systems like cloud storage. In this paper, we present a unified framework to describe some repair-efficient regenerating codes in order to reduce the bandwidth cost in regenerating the lost data. We build an evaluation system to measure the performance of these codes during file encoding, file decoding and individual failure repairing with given feasible parameters. By the experimental comparison and analysis, we validate that the repair-efficient regenerating codes can significantly save much more repair time than traditional erasure codes during repair process at the same storage cost; in particular, some replication-based erasure codes can perform better than others in some certain cases. Our experiments can help researchers to decide which kind of erasure codes to use in building distributed storage systems.
引用
收藏
页码:108 / 116
页数:9
相关论文
共 50 条
  • [1] Replicated Erasure Codes for Storage and Repair-Traffic Efficiency
    Friedman, Roy
    Kantor, Yoav
    Kantor, Amir
    14-TH IEEE INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING (P2P), 2014,
  • [2] Efficient Storage Utilization Using Erasure Codes in OpenStack Cloud
    Kulkarni, Bhagyashri
    Bhosale, Varsha
    2016 INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT), VOL 3, 2015,
  • [3] A C Library of Repair-Efficient Erasure Codes for Distributed Data Storage Systems
    Tian, Chao
    2014 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2014,
  • [4] Replicated Convolutional Codes: A Design Framework for Repair-Efficient Distributed Storage Codes
    Zhu, Bing
    Li, Xin
    Li, Hui
    Shum, Kenneth W.
    2016 54TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2016, : 1018 - 1024
  • [5] Z codes: General Systematic Erasure Codes with Optimal Repair Bandwidth and Storage for Distributed Storage Systems
    Liu, Qing
    Feng, Dan
    Jiang, Hong
    Hu, Yuchong
    Jiao, Tianfeng
    2015 IEEE 34TH SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS), 2015, : 212 - 217
  • [6] Systematic Erasure Codes with Optimal Repair Bandwidth and Storage
    Liu, Qing
    Feng, Dan
    Jiang, Hong
    Hu, Yuchong
    Jiao, Tianfeng
    ACM TRANSACTIONS ON STORAGE, 2017, 13 (03)
  • [7] Adaptive and Scalable Caching With Erasure Codes in Distributed Cloud-Edge Storage Systems
    Liu, Kaiyang
    Peng, Jun
    Wang, Jingrong
    Huang, Zhiwu
    Pan, Jianping
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2023, 11 (02) : 1840 - 1853
  • [8] Repair Delay Analysis of Mobile Storage Systems Using Erasure Codes and Relay Cooperation
    Gu, Shushi
    Lu, Wancheng
    Xiang, Wei
    Zhang, Ning
    Zhang, Qinyu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 10580 - 10593
  • [9] Spider Codes: Practical Erasure Codes for Distributed Storage Systems
    Pamies-Juarez, Lluis
    Guyot, Cyril
    Mateescu, Robert
    2016 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2016, : 1207 - 1211
  • [10] Efficient Dynamic Replicated Data Possession Checking in Distributed Cloud Storage Systems
    Wei, Jinxia
    Liu, Jianyi
    Zhang, Ru
    Niu, Xinxin
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2016,