Coded Distributed Computing Under Combination Networks

被引:0
|
作者
Yang, Yongcheng [1 ]
Huang, Yifei [1 ,2 ]
Qin, Xiaohuan [3 ]
Lu, Shenglian [1 ]
机构
[1] Guangxi Normal Univ, Key Lab Educ Blockchain & Intelligent Technol, Minist Educ, Guilin 541004, Peoples R China
[2] Guilin Univ Aerosp Technol, Sch Sci, Guilin 541004, Peoples R China
[3] Guangxi Normal Univ, Sch Chem & Pharmaceut Sci, State Key Lab Chem & Mol Engn Med Resources, Guilin 541004, Peoples R China
关键词
coded computing; communication; MapReduce; combination network; MAPREDUCE;
D O I
10.3390/e27030311
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Coded distributed computing (CDC) is a powerful approach to reduce the communication overhead in distributed computing frameworks by utilizing coding techniques. In this paper, we focus on the CDC problem in (H,L)-combination networks, where H APs act as intermediate pivots and K=HL workers are connected to different subsets of L APs. Each worker processes a subset of the input file and computes intermediate values (IVs) locally, which are then exchanged via uplink and downlink transmissions through the AP station to ensure that all workers compute their assigned output functions. In this paper, we first novelly characterize the transmission scheme for the shuffle phase from the view point of the coefficient matrix and then obtain the scheme by using the Combined Placement Delivery Array (CPDA). Compared with the baseline scheme, our scheme significantly improves the uplink and downlink communication loads while maintaining the robustness and efficiency of the combined multi-AP network.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Cascaded Coded Distributed Computing on Heterogeneous Networks
    Woolsey, Nicholas
    Chen, Rong-Rong
    Ji, Mingyue
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 2644 - 2648
  • [2] A Combinatorial Design for Cascaded Coded Distributed Computing on General Networks
    Woolsey, Nicholas
    Chen, Rong-Rong
    Ji, Mingyue
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (09) : 5686 - 5700
  • [3] Distributed Decoding for Coded Distributed Computing
    Yazdanialahabadi, Arash
    Ardakani, Masoud
    IEEE INTERNET OF THINGS JOURNAL, 2021, 9 (14) : 12555 - 12562
  • [4] Compressed Coded Distributed Computing
    Li, Songze
    Maddah-Ali, Mohammad Ali
    Avestimehr, A. Salman
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 2032 - 2036
  • [5] Secure Coded Distributed Computing
    Sasi, Shanuja
    Giinlii, Onur
    2024 IEEE 25TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS, SPAWC 2024, 2024, : 811 - 815
  • [6] Compressed Coded Distributed Computing
    Elkordy, Ahmed Roushdy
    Li, Songze
    Maddah-Ali, Mohammad Ali
    Avestimehr, A. Salman
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (05) : 2773 - 2783
  • [7] Topological Coded Distributed Computing
    Wan, Kai
    Ji, Mingyue
    Caire, Giuseppe
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [8] Stream Distributed Coded Computing
    Cohen A.
    Thiran G.
    Esfahanizadeh H.
    Medard M.
    IEEE Journal on Selected Areas in Information Theory, 2021, 2 (03): : 1025 - 1040
  • [9] On Heterogeneous Coded Distributed Computing
    Kiamari, Mehrdad
    Wang, Chenwei
    Avestimehr, A. Salman
    GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [10] Creating Robust Deep Neural Networks With Coded Distributed Computing for IoT
    Hadidi, Ramyad
    Cao, Jiashen
    Asgari, Bahar
    Kim, Hyesoon
    2023 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND COMMUNICATIONS, EDGE, 2023, : 126 - 132