Reducing Repair Traffic with Exact and Uncoded Repair in Distributed Storage Systems: Intersecting Zigzag Sets Codes on Hierarchical Codes

被引:0
|
作者
You, Pengfei [1 ]
Huang, Zhen [1 ]
Wang, Changjian [1 ]
Peng, Yuxing [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha, Hunan, Peoples R China
来源
2014 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE) | 2014年
关键词
distributed storage; network coding; regenerating code; IZS code; hierarchical code; repair traffic;
D O I
10.1109/CSE.2014.150
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Erasure code is an efficient redundancy solution to avoid permanent data losses in distributed storage system. By using erasure code, the original data is encoded into blocks which are stored on different nodes. When one node fails, the lost data block needs to be recovered by transmitting a large number of data from helper nodes, which is called repair. Intersecting zigzag sets codes (IZS codes) and hierarchical code are two kinds of codes which reduce the bandwidth overhead in repair. IZS codes reduce the amount of data uploaded by each helper node, while hierarchical codes reduce the number of nodes participating in repair. In this paper, we propose a class of code called intersecting zigzag sets-hierarchical code (IZ2SHC code) to unify them together. IZ2SHC code decreases repair degree as hierarchical code and reduces repair overhead compared with the latter. Besides, it realizes exact regeneration of the failed data, and need not encode in helper node during the repair, which reduces disk read cost for helper node when transferring data in repair.
引用
收藏
页码:722 / 728
页数:7
相关论文
共 50 条
  • [21] A New Repair Strategy for the Hadamard Minimum Storage Regenerating Codes for Distributed Storage Systems
    Tang, Xiaohu
    Yang, Bin
    Li, Jie
    Hollmann, Henk D. L.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2015, 61 (10) : 5271 - 5279
  • [22] Scalable Family of Codes with Locality and Availability for Information Repair in Distributed Storage Systems
    Farkas, Peter
    2019 4TH INTERNATIONAL CONFERENCE ON SMART AND SUSTAINABLE TECHNOLOGIES (SPLITECH), 2019, : 156 - 159
  • [23] A Generic Transformation to Enable Optimal Repair in MDS Codes for Distributed Storage Systems
    Li, Jie
    Tang, Xiaohu
    Tian, Chao
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (09) : 6257 - 6267
  • [24] On Secure Distributed Storage Systems with Exact Repair
    Tandon, Ravi
    Amuru, SaiDhiraj
    Clancy, T. Charles
    Buehrer, R. Michael
    2014 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2014, : 3908 - 3912
  • [25] Replicated Convolutional Codes: A Design Framework for Repair-Efficient Distributed Storage Codes
    Zhu, Bing
    Li, Xin
    Li, Hui
    Shum, Kenneth W.
    2016 54TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2016, : 1018 - 1024
  • [26] Replicated Erasure Codes for Storage and Repair-Traffic Efficiency
    Friedman, Roy
    Kantor, Yoav
    Kantor, Amir
    14-TH IEEE INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING (P2P), 2014,
  • [27] Cooperative Repair with Minimum-Storage Regenerating Codes for Distributed Storage
    Li, Jun
    Li, Baochun
    2014 PROCEEDINGS IEEE INFOCOM, 2014, : 316 - 324
  • [28] On the minimum storage overhead of distributed storage codes with a given repair locality
    Hollmann, Henk D. L.
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 1041 - 1045
  • [29] Improved Layered Regenerating Codes Characterizing the Exact-Repair Storage-Repair Bandwidth Tradeoff for Certain Parameter Sets
    Senthoor, Kaushik
    Sasidharan, Birenjith
    Kumar, P. Vijay
    2015 IEEE INFORMATION THEORY WORKSHOP (ITW), 2015,
  • [30] MDS Codes with Low Repair Complexity for Distributed Storage Networks
    Xie, Hongmei
    Yan, Zhiyuan
    2013 22ND WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC 2013), 2013, : 384 - 387