Coded Distributed Computing Under Combination Networks

被引:0
|
作者
Yang, Yongcheng [1 ]
Huang, Yifei [1 ,2 ]
Qin, Xiaohuan [3 ]
Lu, Shenglian [1 ]
机构
[1] Guangxi Normal Univ, Key Lab Educ Blockchain & Intelligent Technol, Minist Educ, Guilin 541004, Peoples R China
[2] Guilin Univ Aerosp Technol, Sch Sci, Guilin 541004, Peoples R China
[3] Guangxi Normal Univ, Sch Chem & Pharmaceut Sci, State Key Lab Chem & Mol Engn Med Resources, Guilin 541004, Peoples R China
关键词
coded computing; communication; MapReduce; combination network; MAPREDUCE;
D O I
10.3390/e27030311
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Coded distributed computing (CDC) is a powerful approach to reduce the communication overhead in distributed computing frameworks by utilizing coding techniques. In this paper, we focus on the CDC problem in (H,L)-combination networks, where H APs act as intermediate pivots and K=HL workers are connected to different subsets of L APs. Each worker processes a subset of the input file and computes intermediate values (IVs) locally, which are then exchanged via uplink and downlink transmissions through the AP station to ensure that all workers compute their assigned output functions. In this paper, we first novelly characterize the transmission scheme for the shuffle phase from the view point of the coefficient matrix and then obtain the scheme by using the Combined Placement Delivery Array (CPDA). Compared with the baseline scheme, our scheme significantly improves the uplink and downlink communication loads while maintaining the robustness and efficiency of the combined multi-AP network.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Energy Efficient Partial Distributed Coded Computing in Edge Computing
    Li, Yuepeng
    Zeng, Deze
    Geng, Hongmin
    Yang, Zaihang
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 3076 - 3080
  • [22] Coded Computing for Master-Aided Distributed Computing Systems
    Chen, Haoning
    Wu, Youlong
    2020 IEEE INFORMATION THEORY WORKSHOP (ITW), 2021,
  • [23] Verifiable Coded Computing: Towards Fast and Secure Distributed Computing
    Tang, Tingting
    2021 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2021, : 1022 - 1022
  • [24] Coded Distributed Computing with Heterogeneous Function Assignments
    Woolsey, Nicholas
    Chen, Rong-Rong
    Ji, Mingyue
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [25] On Allocation of Systematic Blocks in Coded Distributed Computing
    Ardakani, Maryam Haghighi
    Mehrabi, Mehrad
    Ardakani, Masoud
    Tellambura, Chintha
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (04) : 748 - 752
  • [26] A New Combinatorial Design of Coded Distributed Computing
    Woolsey, Nicholas
    Chen, Rong-Rong
    Ji, Mingyue
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 726 - 730
  • [27] Masterless Coded Computing: A Fully-Distributed Coded FFT Algorithm
    Jeong, Haewon
    Low, Tze Meng
    Grover, Pulkit
    2018 56TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2018, : 887 - 894
  • [28] Coded Caching for Combination Networks with Multiaccess
    Huang, Leitang
    Wang, Jinyu
    Cheng, Minquan
    Deng, Qingyong
    Zhong, Bineng
    INFORMATION, 2022, 13 (04)
  • [29] Coded Distributed Computing: Performance Limits and Code Designs
    Jamali, Mohammad Vahid
    Soleymani, Mahdi
    Mahdavifar, Hessam
    2019 IEEE INFORMATION THEORY WORKSHOP (ITW), 2019, : 399 - 403
  • [30] Coded Computing for Multi-Cluster Distributed Computations
    Wu, Youlong
    Li, Chenglin
    Hu, Haoyang
    Song, Xiyu
    Ma, Shuai
    Shi, Yuanming
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2025, 73 (02) : 1114 - 1127