LT Codes with Feedback: Accelerate the Distributed Matrix-Vector Multiplication with Stragglers

被引:0
|
作者
Yang, Xiao [1 ]
Jiang, Ming [1 ,2 ]
Zhao, Chunming [1 ,2 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing, Peoples R China
[2] Purple Mt Lab, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
rateless feedback codes; distributed computation; stragglers;
D O I
10.1109/ipccc47392.2019.8958745
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a coding scheme for distributed matrix-vector multiplication that builds upon the Luby transform (LT) codes with feedback. The ideal soliton distribution is utilized in our LT coding scheme to encode the sub-matrices. Besides, the belief propagation (BP) decoding algorithm is modified to cooperate with the feedback information. Compared with other coded distributed computations with straggling servers, our approach achieves lower computation latency when the overall delay incurred by the encoding, mapping and decoding process is considered. Furthermore, we compare the storage loads of different schemes and show that the LT coding with feedback has a strong comparative advantage in these straggler-tolerant computation scenarios.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] FAST MULTIRESOLUTION ALGORITHMS FOR MATRIX-VECTOR MULTIPLICATION
    HARTEN, A
    YADSHALOM, I
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 1994, 31 (04) : 1191 - 1218
  • [22] Matrix-Vector Multiplication in Adaptive Wavelet Methods
    Cerna, Dana
    Finek, Vaclav
    APPLICATIONS OF MATHEMATICS IN ENGINEERING AND ECONOMICS (AMEE'11): PROCEEDINGS OF THE 37TH INTERNATIONAL CONFERENCE, 2011, 1410
  • [23] REALIZATION OF DIGITAL OPTICAL MATRIX-VECTOR MULTIPLICATION
    BANDYOPADHYAY, S
    DATTA, AK
    BAWA, SS
    BIRADAR, AM
    CHANDRA, S
    JOURNAL OF PHYSICS D-APPLIED PHYSICS, 1995, 28 (01) : 7 - 11
  • [24] Understanding the performance of sparse matrix-vector multiplication
    Goumas, Georgios
    Kourtis, Kornilios
    Anastopoulos, Nikos
    Karakasis, Vasileios
    Koziris, Nectarios
    PROCEEDINGS OF THE 16TH EUROMICRO CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING, 2008, : 283 - +
  • [25] Sparse matrix-vector multiplication design on FPGAs
    Sun, Junqing
    Peterson, Gregory
    Storaasli, Olaf
    FCCM 2007: 15TH ANNUAL IEEE SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, PROCEEDINGS, 2007, : 349 - +
  • [26] Sparse Matrix-Vector Multiplication on a Reconfigurable Supercomputer
    DuBois, David
    DuBois, Andrew
    Connor, Carolyn
    Poole, Steve
    PROCEEDINGS OF THE SIXTEENTH IEEE SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, 2008, : 239 - +
  • [27] Node aware sparse matrix-vector multiplication
    Bienz, Amanda
    Gropp, William D.
    Olson, Luke N.
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2019, 130 : 166 - 178
  • [28] A Method of Zero/One Matrix-Vector Multiplication
    Yu, Li
    Liu, Xia
    Chen, Ang
    Li, Yuan-Xiang
    PROCEEDINGS OF FIRST INTERNATIONAL CONFERENCE OF MODELLING AND SIMULATION, VOL III: MODELLING AND SIMULATION IN ELECTRONICS, COMPUTING, AND BIO-MEDICINE, 2008, : 95 - 99
  • [29] STRUCTURED SPARSE MATRIX-VECTOR MULTIPLICATION ON A MASPAR
    DEHN, T
    EIERMANN, M
    GIEBERMANN, K
    SPERLING, V
    ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1994, 74 (06): : T534 - T538
  • [30] AN EFFICIENT PARALLEL ALGORITHM FOR MATRIX-VECTOR MULTIPLICATION
    HENDRICKSON, B
    LELAND, R
    PLIMPTON, S
    INTERNATIONAL JOURNAL OF HIGH SPEED COMPUTING, 1995, 7 (01): : 73 - 88