Wireless Federated Learning over Resource-Constrained Networks: Digital versus Analog Transmissions

被引:4
|
作者
Yao J. [1 ]
Xu W. [1 ]
Yang Z. [2 ]
You X. [1 ]
Bennis M. [3 ]
Poor H.V. [4 ]
机构
[1] National Mobile Communications Research Laboratory (NCRL), Southeast University, Nanjing
[2] Zhejiang Lab, Hangzhou
[3] Center for Wireless Communications, Oulu University, Oulu
[4] Department of Electrical and Computer Engineering, Princeton University, NJ
基金
欧盟地平线“2020”; 美国国家科学基金会;
关键词
Computational modeling; Convergence; convergence analysis; digital communication; Federated learning (FL); Optimization; over-the-air computation (AirComp); Task analysis; Training; Uplink; Wireless networks;
D O I
10.1109/TWC.2024.3407822
中图分类号
学科分类号
摘要
To enable wireless federated learning (FL) in communication resource-constrained networks, two communication schemes, i.e., digital and analog ones, are effective solutions. In this paper, we quantitatively compare these two techniques, highlighting their essential differences as well as respectively suitable scenarios. We first examine both digital and analog transmission schemes, together with a unified and fair comparison framework under imbalanced device sampling, strict latency targets, and transmit power constraints. A universal convergence analysis under various imperfections is established for evaluating the performance of FL over wireless networks. These analytical results reveal that the fundamental difference between the digital and analog communications lies in whether communication and computation are jointly designed or not. The digital scheme decouples the communication design from FL computing tasks, making it difficult to support uplink transmission from massive devices with limited bandwidth and hence the performance is mainly communication-limited. In contrast, the analog communication allows over-the-air computation (AirComp) and achieves better spectrum utilization. However, the computation-oriented analog transmission reduces power efficiency, and its performance is sensitive to computation errors from imperfect channel state information (CSI). Furthermore, device sampling for both schemes are optimized and differences in sampling optimization are analyzed. Numerical results verify the theoretical analysis and affirm the superior performance of the sampling optimization. IEEE
引用
收藏
页码:1 / 1
相关论文
共 50 条
  • [41] Enabling Machine Learning on Resource-constrained Tactical Networks
    Perazzone, Jake
    Dwyer, Matthew
    Chan, Kevin
    Anderson, Cleon
    Brown, Scott
    2022 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2022,
  • [42] A Federated Learning Framework for Resource Constrained Fog Networks
    Lalouani, Wassila
    Younis, Mohamed
    2022 27TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2022), 2022,
  • [43] RIS-Based Over-the-Air Channel Equalization in Resource-Constrained Wireless Networks
    Prod'homme, Hugo
    Imani, Mohammadreza F.
    Abadal, Sergi
    del Hougne, Philipp
    2024 18TH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION, EUCAP, 2024,
  • [44] Reinforcement Learning for Real-Time Federated Learning for Resource-Constrained Edge Cluster
    Rajashekar, Kolichala
    Paul, Souradyuti
    Karmakar, Sushanta
    Sidhanta, Subhajit
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2024, 32 (04)
  • [45] Federated Learning With Selective Knowledge Distillation Over Bandwidth-constrained Wireless Networks
    Gad, Gad
    Fadlullah, Zubair Md
    Fouda, Mostafa M.
    Ibrahem, Mohamed I.
    Kato, Nei
    ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, : 3476 - 3481
  • [46] Efficient federated learning on resource-constrained edge devices based on model pruning
    Wu, Tingting
    Song, Chunhe
    Zeng, Peng
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (06) : 6999 - 7013
  • [47] Unleashing Edgeless Federated Learning With Analog Transmissions
    Yang, Howard H.
    Chen, Zihan
    Quek, Tony Q. S.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2024, 72 : 774 - 791
  • [48] Unleashing Edgeless Federated Learning With Analog Transmissions
    Yang, Howard H.
    Chen, Zihan
    Quek, Tony Q. S.
    IEEE Transactions on Signal Processing, 2024, 72 : 774 - 791
  • [49] Communication-efficient asynchronous federated learning in resource-constrained edge computing
    Liu, Jianchun
    Xu, Hongli
    Xu, Yang
    Ma, Zhenguo
    Wang, Zhiyuan
    Qian, Chen
    Huang, He
    COMPUTER NETWORKS, 2021, 199
  • [50] A Digital Implementation of Extreme Learning Machines for Resource-Constrained Devices
    Ragusa, Edoardo
    Gianoglio, Christian
    Gastaldo, Paolo
    Zunino, Rodolfo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2018, 65 (08) : 1104 - 1108