Wireless Federated Learning over Resource-Constrained Networks: Digital versus Analog Transmissions

被引:4
|
作者
Yao J. [1 ]
Xu W. [1 ]
Yang Z. [2 ]
You X. [1 ]
Bennis M. [3 ]
Poor H.V. [4 ]
机构
[1] National Mobile Communications Research Laboratory (NCRL), Southeast University, Nanjing
[2] Zhejiang Lab, Hangzhou
[3] Center for Wireless Communications, Oulu University, Oulu
[4] Department of Electrical and Computer Engineering, Princeton University, NJ
基金
欧盟地平线“2020”; 美国国家科学基金会;
关键词
Computational modeling; Convergence; convergence analysis; digital communication; Federated learning (FL); Optimization; over-the-air computation (AirComp); Task analysis; Training; Uplink; Wireless networks;
D O I
10.1109/TWC.2024.3407822
中图分类号
学科分类号
摘要
To enable wireless federated learning (FL) in communication resource-constrained networks, two communication schemes, i.e., digital and analog ones, are effective solutions. In this paper, we quantitatively compare these two techniques, highlighting their essential differences as well as respectively suitable scenarios. We first examine both digital and analog transmission schemes, together with a unified and fair comparison framework under imbalanced device sampling, strict latency targets, and transmit power constraints. A universal convergence analysis under various imperfections is established for evaluating the performance of FL over wireless networks. These analytical results reveal that the fundamental difference between the digital and analog communications lies in whether communication and computation are jointly designed or not. The digital scheme decouples the communication design from FL computing tasks, making it difficult to support uplink transmission from massive devices with limited bandwidth and hence the performance is mainly communication-limited. In contrast, the analog communication allows over-the-air computation (AirComp) and achieves better spectrum utilization. However, the computation-oriented analog transmission reduces power efficiency, and its performance is sensitive to computation errors from imperfect channel state information (CSI). Furthermore, device sampling for both schemes are optimized and differences in sampling optimization are analyzed. Numerical results verify the theoretical analysis and affirm the superior performance of the sampling optimization. IEEE
引用
收藏
页码:1 / 1
相关论文
共 50 条
  • [21] An Effective Approach for Resource-Constrained Edge Devices in Federated Learning
    Wen, Jun
    Li, Xiusheng
    Chen, Yupeng
    Li, Xiaoli
    Mao, Hang
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [22] Implementation of Federated Learning on Resource-constrained devices: Lessons learned
    Tsouparopoulos, Thomas
    Koutsopoulos, Iordanis
    2022 IFIP NETWORKING CONFERENCE (IFIP NETWORKING), 2022,
  • [23] Reinforcement learning based flow and energy management in resource-constrained wireless networks
    Dutta, Hrishikesh
    Bhuyan, Amit Kumar
    Biswas, Subir
    COMPUTER COMMUNICATIONS, 2023, 202 : 73 - 86
  • [24] Butterfly Encryption Scheme for Resource-Constrained Wireless Networks
    Sampangi, Raghav V.
    Sampalli, Srinivas
    SENSORS, 2015, 15 (09) : 23145 - 23167
  • [25] Slotted ALOHA for Wireless Powered Resource-Constrained Networks
    Silva, Cleyson de, V
    Carvalho, Marcelo M.
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [26] Resource Management and Fairness for Federated Learning over Wireless Edge Networks
    Balakrishnan, Ravikumar
    Akdeniz, Mustafa
    Dhakal, Sagar
    Himayat, Nageen
    PROCEEDINGS OF THE 21ST IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC2020), 2020,
  • [27] Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation
    Dinh, Canh T.
    Tran, Nguyen H.
    Nguyen, Minh N. H.
    Hong, Choong Seon
    Bao, Wei
    Zomaya, Albert Y.
    Gramoli, Vincent
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2021, 29 (01) : 398 - 409
  • [28] Feasibility of PKC in Resource-Constrained Wireless Sensor Networks
    Pathan, Al-Sakib Khan
    Hong, Choong Seon
    2008 11TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY: ICCIT 2008, VOLS 1 AND 2, 2008, : 905 - 912
  • [29] SECURING RESOURCE-CONSTRAINED WIRELESS AD HOC NETWORKS
    Fang, Yuguang
    Zhu, Xiaoyan
    Zhang, Yanchao
    IEEE WIRELESS COMMUNICATIONS, 2009, 16 (02) : 24 - 29
  • [30] Securing resource-constrained wireless ad hoc networks
    Fang, Yuguang
    Zhang, Yanchao
    2007 IEEE SARNOFF SYMPOSIUM, 2007, : 477 - +