LT Codes with Feedback: Accelerate the Distributed Matrix-Vector Multiplication with Stragglers

被引:0
|
作者
Yang, Xiao [1 ]
Jiang, Ming [1 ,2 ]
Zhao, Chunming [1 ,2 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing, Peoples R China
[2] Purple Mt Lab, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
rateless feedback codes; distributed computation; stragglers;
D O I
10.1109/ipccc47392.2019.8958745
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a coding scheme for distributed matrix-vector multiplication that builds upon the Luby transform (LT) codes with feedback. The ideal soliton distribution is utilized in our LT coding scheme to encode the sub-matrices. Besides, the belief propagation (BP) decoding algorithm is modified to cooperate with the feedback information. Compared with other coded distributed computations with straggling servers, our approach achieves lower computation latency when the overall delay incurred by the encoding, mapping and decoding process is considered. Furthermore, we compare the storage loads of different schemes and show that the LT coding with feedback has a strong comparative advantage in these straggler-tolerant computation scenarios.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] GPU accelerated sparse matrix-vector multiplication and sparse matrix-transpose vector multiplication
    Tao, Yuan
    Deng, Yangdong
    Mu, Shuai
    Zhang, Zhenzhong
    Zhu, Mingfa
    Xiao, Limin
    Ruan, Li
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (14): : 3771 - 3789
  • [32] The Mailman algorithm: A note on matrix-vector multiplication
    Liberty, Edo
    Zucker, Steven W.
    INFORMATION PROCESSING LETTERS, 2009, 109 (03) : 179 - 182
  • [33] A REUSABLE SYSTOLIC ARRAY FOR MATRIX-VECTOR MULTIPLICATION
    EVANS, DJ
    MARGARITIS, KG
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 1991, 41 (1-2) : 19 - 30
  • [34] Performance Aspects of Sparse Matrix-Vector Multiplication
    Simecek, I.
    ACTA POLYTECHNICA, 2006, 46 (03) : 3 - 8
  • [35] DENSE MATRIX-VECTOR MULTIPLICATION ON THE CUDA ARCHITECTURE
    Fujimoto, Noriyuki
    PARALLEL PROCESSING LETTERS, 2008, 18 (04) : 511 - 530
  • [36] Efficient dense matrix-vector multiplication on GPU
    He, Guixia
    Gao, Jiaquan
    Wang, Jun
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (19):
  • [37] Multithreaded Reproducible Banded Matrix-Vector Multiplication
    Tang, Tao
    Qi, Haijun
    Lu, Qingfeng
    Jiang, Hao
    MATHEMATICS, 2024, 12 (03)
  • [38] A quantum algorithm for Toeplitz matrix-vector multiplication
    Gao, Shang
    Yang, Yu-Guang
    CHINESE PHYSICS B, 2023, 32 (10)
  • [39] On improving the performance of sparse matrix-vector multiplication
    White, JB
    Sadayappan, P
    FOURTH INTERNATIONAL CONFERENCE ON HIGH-PERFORMANCE COMPUTING, PROCEEDINGS, 1997, : 66 - 71
  • [40] A quantum algorithm for Toeplitz matrix-vector multiplication
    高尚
    杨宇光
    Chinese Physics B, 2023, 32 (10) : 292 - 297