Coded Distributed Computing Under Combination Networks

被引:0
|
作者
Yang, Yongcheng [1 ]
Huang, Yifei [1 ,2 ]
Qin, Xiaohuan [3 ]
Lu, Shenglian [1 ]
机构
[1] Guangxi Normal Univ, Key Lab Educ Blockchain & Intelligent Technol, Minist Educ, Guilin 541004, Peoples R China
[2] Guilin Univ Aerosp Technol, Sch Sci, Guilin 541004, Peoples R China
[3] Guangxi Normal Univ, Sch Chem & Pharmaceut Sci, State Key Lab Chem & Mol Engn Med Resources, Guilin 541004, Peoples R China
关键词
coded computing; communication; MapReduce; combination network; MAPREDUCE;
D O I
10.3390/e27030311
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Coded distributed computing (CDC) is a powerful approach to reduce the communication overhead in distributed computing frameworks by utilizing coding techniques. In this paper, we focus on the CDC problem in (H,L)-combination networks, where H APs act as intermediate pivots and K=HL workers are connected to different subsets of L APs. Each worker processes a subset of the input file and computes intermediate values (IVs) locally, which are then exchanged via uplink and downlink transmissions through the AP station to ensure that all workers compute their assigned output functions. In this paper, we first novelly characterize the transmission scheme for the shuffle phase from the view point of the coefficient matrix and then obtain the scheme by using the Combined Placement Delivery Array (CPDA). Compared with the baseline scheme, our scheme significantly improves the uplink and downlink communication loads while maintaining the robustness and efficiency of the combined multi-AP network.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Coded Distributed Computing for Sparse Functions With Structured Support
    Brunero, Federico
    Wan, Kai
    Caire, Giuseppe
    Elia, Petros
    2023 IEEE INFORMATION THEORY WORKSHOP, ITW, 2023, : 474 - 479
  • [42] Coded Wireless Distributed Computing With Packet Losses and Retransmissions
    Han, Dong-Jun
    Sohn, Jy-Yong
    Moon, Jaekyun
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (12) : 8204 - 8217
  • [43] Coded Distributed Computing For Vehicular Edge Computing With Dual -Function Radar Communication
    Hoai Linh Nguyen Thi
    Hoang Le Hung
    Nguyen Cong Luong
    Tien Hoa Nguyen
    Xiao, Sa
    Tan, Junjie
    Niyato, Dusit
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [44] On Batch-Processing Based Coded Computing for Heterogeneous Distributed Computing Systems
    Wang, Baoqian
    Xie, Junfei
    Lu, Kejie
    Wan, Yan
    Fu, Shengli
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (03): : 2438 - 2454
  • [45] On the Robustness of Distributed Computing Networks
    Zhang, Jianan
    Lee, Hyang-Won
    Modiano, Eytan
    2019 15TH INTERNATIONAL CONFERENCE ON THE DESIGN OF RELIABLE COMMUNICATION NETWORKS (DRCN 2019), 2019, : 122 - 129
  • [46] DISTRIBUTED DIAGNOSIS FOR COMPUTING NETWORKS
    DALCIN, M
    MICROPROCESSING AND MICROPROGRAMMING, 1984, 14 (3-4): : 139 - 144
  • [47] DISTRIBUTED COMPUTING, LINKS AND NETWORKS
    SENDALL, DM
    PHYSICA SCRIPTA, 1981, 23 (04): : 512 - 519
  • [48] DISTRIBUTED COMPUTING NETWORKS THE CPI
    CHOWDHURY, J
    CHEMICAL ENGINEERING, 1993, 100 (12) : 45 - &
  • [49] Synchronization and Deduplication in Coded Distributed Storage Networks
    El Rouayheb, Salim
    Goparaju, Sreechakra
    Kiah, Han Mao
    Milenkovic, Olgica
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) : 3056 - 3069
  • [50] Coded Caching in Combination Networks with Heterogeneous Caches
    Guan, Zhuodong
    Wang, Xiaoxia
    Zhang, Jinbei
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 286 - 291