Delay Performance of Direct Reads in Distributed Storage Systems with Coding

被引:7
|
作者
Shuai, Qiqi [1 ]
Li, Victor O. K. [1 ]
机构
[1] Univ Hong Kong, Dept EEE, Hong Kong, Hong Kong, Peoples R China
关键词
Delay; direct reads; hot data; MDS codes; degraded reads; bandwidth cost; load balancing; CLOUD STORAGE; TRADE-OFF;
D O I
10.1109/HPCC-CSS-ICESS.2015.200
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Delay performance is crucial in distributed storage systems and it can greatly impact user experience. Both direct and k-access reads are common in storage systems. However, much of previous research only considers k-access reads and many schemes, such as Redundant Scheme, are only shown to reduce delay for k-access reads. We have no idea whether those existing schemes can also work for direct reads. The study regarding the characteristics of the delay performance of direct reads, and the appropriate schemes for direct reads to reduce delay is still lacking. In this paper, we study the delay performance of direct reads and its correlation with degraded reads. We illustrate the relationship between degraded reads and bandwidth cost and answer important questions like when degraded reads can help reduce delay. Then we propose a scheme DRALB to reduce delay for direct reads. DRALB can be easily added to existing schemes and can greatly reduce the delay of hot data. We also conduct trace-driven simulations to verify that DRALB significantly outperforms existing schemes, in terms of delay performance of direct reads.
引用
收藏
页码:184 / 189
页数:6
相关论文
共 50 条
  • [1] Latency Performance Model of Direct and K-access Reads in Distributed Storage Systems
    Shuai, Qiqi
    Li, Victor O. K.
    PROCEEDINGS OF 2016 IEEE 18TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS; IEEE 14TH INTERNATIONAL CONFERENCE ON SMART CITY; IEEE 2ND INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2016, : 1021 - 1028
  • [2] Graftage Coding for Distributed Storage Systems
    Rui, Jiayi
    Huang, Qin
    Wang, Zulin
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2021, 67 (04) : 2192 - 2205
  • [3] Network coding for distributed storage systems
    Dimakis, Alexandros G.
    Godfrey, P. Brighten
    Wainwright, Martin J.
    Ramchandran, Kannan
    INFOCOM 2007, VOLS 1-5, 2007, : 2000 - +
  • [4] Graftage Coding for Distributed Storage Systems
    Huang, Qin
    Rui, Jiayi
    Song, Liyuan
    Wang, Zulin
    2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [5] Network Coding for Distributed Storage Systems
    Dimakis, Alexandros G.
    Godfrey, P. Brighten
    Wu, Yunnan
    Wainwright, Martin J.
    Ramchandran, Kannan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (09) : 4539 - 4551
  • [6] On Data Parallelism of Erasure Coding in Distributed Storage Systems
    Li, Jun
    Li, Baochun
    2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2017), 2017, : 45 - 56
  • [7] Coding Techniques for Repairability in Networked Distributed Storage Systems
    Oggier, Frederique
    Datta, Anwitaman
    FOUNDATIONS AND TRENDS IN COMMUNICATIONS AND INFORMATION THEORY, 2012, 9 (04): : 383 - 466
  • [8] Efficient Random Network Coding for Distributed Storage Systems
    Visegradi, Adam
    Kacsuk, Peter
    EURO-PAR 2013: PARALLEL PROCESSING WORKSHOPS, 2014, 8374 : 385 - 394
  • [9] Erasure-Coding-Based Storage and Recovery for Distributed Exascale Storage Systems
    Kim, Jeong-Joon
    APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [10] Storage vs Repair Bandwidth for Network Erasure Coding in Distributed Storage Systems
    Singal, Swati Mittal
    Rakesh, Nitin
    Matam, Rakesh
    2015 INTERNATIONAL CONFERENCE ON SOFT COMPUTING TECHNIQUES AND IMPLEMENTATIONS (ICSCTI), 2015,