Load-balanced sparse matrix-vector multiplication on parallel computers

被引:2
|
作者
Nastea, SG [1 ]
Frieder, O
El-Ghazawi, T
机构
[1] Polytech Univ Bucharest, Dept Control & Comp, Bucharest, Romania
[2] Florida Inst Technol, Melbourne, FL 32901 USA
[3] George Mason Univ, Fairfax, VA USA
基金
美国国家科学基金会;
关键词
Sparse matrix-vector; multiplication; load balancing; parallel computations; greedy allocation; optimized message passing;
D O I
10.1006/jpdc.1997.1361
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We considered the load-balanced multiplication of a large sparse matrix with a large sequence of vectors on parallel computers, We propose a method that combines fast load-balancing with efficient message-passing techniques to alleviate computational and inter-node communications challenges. The performance of the proposed method was evaluated on benchmark as well as on synthetically generated matrices and compared with the current work. It is shown that, by using our approach, a tangible improvement over prior work can be obtained, particularly for very sparse and skewed matrices, Moreover, it is also shown that I/O overhead for this problem can be efficiently amortized through I/O latency hiding and overall load-balancing. (C) 1997 Academic Press.
引用
收藏
页码:180 / 193
页数:14
相关论文
共 50 条
  • [1] An Efficient Sparse Matrix-Vector Multiplication on Distributed Memory Parallel Computers
    Shahnaz, Rukhsana
    Usman, Anila
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2007, 7 (01): : 77 - 82
  • [2] Well balanced sparse matrix-vector multiplication on a parallel heterogeneous system
    Jiogo, C. Dongmo
    Manneback, P.
    Kuonen, P.
    2006 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, VOLS 1 AND 2, 2006, : 665 - +
  • [3] Sparse Binary Matrix-Vector Multiplication on Neuromorphic Computers
    Schuman, Catherine D.
    Kay, Bill
    Date, Prasanna
    Kannan, Ramakrishnan
    Sao, Piyush
    Potok, Thomas E.
    2021 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2021, : 308 - 311
  • [4] Blocked-Based Sparse Matrix-Vector Multiplication on Distributed Memory Parallel Computers
    Shahnaz, Rukhsana
    Usman, Anila
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2011, 8 (02) : 130 - 136
  • [5] Load-balancing in sparse matrix-vector multiplication
    Nastea, SG
    Frieder, O
    ElGhazawi, T
    EIGHTH IEEE SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING, PROCEEDINGS, 1996, : 218 - 225
  • [6] Communication balancing in parallel sparse matrix-vector multiplication
    Bisseling, RH
    Meesen, W
    ELECTRONIC TRANSACTIONS ON NUMERICAL ANALYSIS, 2005, 21 : 47 - 65
  • [7] Parallel Sparse Matrix-Vector Multiplication Using Accelerators
    Maeda, Hiroshi
    Takahashi, Daisuke
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2016, PT II, 2016, 9787 : 3 - 18
  • [8] Fast sparse matrix-vector multiplication for TeraFlop/s computers
    Wellein, G
    Hager, G
    Basermann, A
    Fehske, H
    HIGH PERFORMANCE COMPUTING FOR COMPUTATIONAL SCIENCE - VECPAR 2002, 2003, 2565 : 287 - 301
  • [9] A model-driven blocking strategy for load balanced sparse matrix-vector multiplication on GPUs
    Ashari, Arash
    Sedaghati, Naser
    Eisenlohr, John
    Sadayappan, P.
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2015, 76 : 3 - 15
  • [10] Merge-based Parallel Sparse Matrix-Vector Multiplication
    Merrill, Duane
    Garland, Michael
    SC '16: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2016, : 678 - 689