A New Minimize Matrix Computation Coding Method for Distributed Storage Systems

被引:0
|
作者
Yin, Chao [1 ]
Lv, Haitao [1 ]
Li, Tongfang [1 ]
Qu, Xiaoping [1 ]
Wang, Jianzong [2 ]
Gao, Guangyong [3 ]
机构
[1] Jiujiang Univ, Dept Informat Sci & Technol, Jiujiang, Peoples R China
[2] Ping An Technol Shenzhen Co Ltd, Dept Fed Learning Technol, Shenzhen, Guangdong, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Dept Sch Comp & Software, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
CODES;
D O I
10.1155/2019/4163780
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the number of nodes increasing in scale, the requirements of storage space enlarge sharply in distributed storage systems. Failure-tolerance schemes such as Reed-Solomon codes (RS codes in short) and Cauchy Reed-Solomon codes (CRS codes in short) are used to save storage space. However, these failure-tolerance schemes severely degrade the system performance. In this paper, we propose optimal RS codes (OptRS codes in short) based on RS codes and CRS codes that can offer better performance for encoding and decoding as well as maximizing the utilization of storage space. OptRS codes can speed up the matrix computation which is regarded as the most important factor to impact the efficiency of coding by transferring the matrix computation from the Galois field mapping to the XOR operation. OptRS codes employ an algorithm called row elimination scheme (RE scheme in short), which can eliminate the same XOR operation to minimize the number of XOR operations. We analyze optimal matrices (OM in short) in theory, which prove the optimal performance of OptRS codes over the Galois field. Our method is implemented on the top of the distributed storage system, and code parameters were carefully chosen. The test result shows that OptRS codes can improve the performance in different data block numbers, parity block numbers, block size, normal reading, and degraded reading, compared with RS codes and CRS codes.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Reliability study of coding schemes for wide-area distributed storage systems
    Peter, Kathrin
    PROCEEDINGS OF THE 19TH INTERNATIONAL EUROMICRO CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING, 2011, : 19 - 23
  • [42] Accelerating erasure coding by exploiting multiple repair paths in distributed storage systems
    Kim, Chanki
    Chon, Kang-Wook
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (06): : 8621 - 8635
  • [43] UHUM: An Efficient Hybrid Update Mechanism in Distributed Storage Systems with Erasure Coding
    Luo, Qian
    Wang, Yun
    PROCEEDINGS OF THE 2019 IEEE 23RD INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2019, : 158 - 163
  • [44] A Repair-Efficient Coding for Distributed Storage Systems Under Piggybacking Framework
    Yuan, Shuai
    Huang, Qin
    Wang, Zulin
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2018, 66 (08) : 3245 - 3254
  • [45] Cooperative Recovery of Distributed Storage Systems from Multiple Losses with Network Coding
    Hu, Yuchong
    Xu, Yinlong
    Wang, Xiaozhao
    Zhan, Cheng
    Li, Pei
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2010, 28 (02) : 268 - 276
  • [46] BPR: An Erasure Coding Batch Parallel Repair Approach in Distributed Storage Systems
    Song, Ying
    Zhao, Wenxuan
    Wang, Bo
    IEEE ACCESS, 2023, 11 : 44509 - 44518
  • [47] Remote Data Checking for Network Coding-based Distributed Storage Systems
    Chen, Bo
    Curtmola, Reza
    Ateniese, Giuseppe
    Burns, Randal
    PROCEEDINGS OF THE 2010 ACM WORKSHOP CLOUD COMPUTING SECURITY WORKSHOP (CCSW'10:), 2010, : 29 - 40
  • [48] OpenEC: Toward Unified and Configurable Erasure Coding Management in Distributed Storage Systems
    Li, Xiaolu
    Li, Runhui
    Lee, Patrick P. C.
    Hu, Yuchong
    PROCEEDINGS OF THE 17TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2019, : 331 - 344
  • [49] Tree-structured Data Regeneration with Network Coding in Distributed Storage Systems
    Li, Jun
    Yang, Shuang
    Wang, Xin
    Xue, Xiangyang
    Li, Baochun
    IWQOS: 2009 IEEE 17TH INTERNATIONAL WORKSHOP ON QUALITY OF SERVICE, 2009, : 19 - +
  • [50] Wireless Distributed Matrix-Vector Multiplication Using Over-the-Air Computation and Analog Coding
    Choi, Jinho
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (08) : 9826 - 9838