Random Aggregate Beamforming for Over-the-Air Federated Learning in Large-Scale Networks

被引:2
|
作者
Xu, Chunmei [1 ,2 ]
Zhang, Cheng [1 ,3 ]
Huang, Yongming [3 ]
Niyato, Dusit [4 ]
机构
[1] Southeast Univ, Sch Informat Sci & Engn, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[2] Univ Surrey, Inst Commun Syst, 5GIC & 6GIC, Guildford GU2 7XH, England
[3] Purple Mt Labs, Nanjing 211111, Peoples R China
[4] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 21期
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
Aggregates; Array signal processing; Wireless networks; Performance evaluation; Computational modeling; Atmospheric modeling; Training; Aggregate beamforming; Air Computation (AirComp); device selection; federated learning (FL); large-scale network;
D O I
10.1109/JIOT.2024.3360190
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, there is a growing trend in deploying ubiquitous artificial intelligence (AI) applications at the network edge. As a promising framework that enables secure edge intelligence, federated learning (FL) has been paid attention, where the over-the-air computing technique has been adopted to enhance the communication efficiency. In this study, we focus on over-the-air FL over a large-scale network with numerous edge devices. Joint device selection and aggregate beamforming design is investigated under two different objectives, i.e., minimizing the aggregate error and maximizing the number of selected devices. Two combinatorial problems are formulated, which are demanding to solve especially in the large-scale network. To reduce the computational complexity, a random aggregate beamforming scheme is proposed, which employs random sampling instead of optimization to determine the aggregator beamforming vector. Notably, the implementation of the proposed scheme does not necessitate the full channel estimation. Asymptotic analysis reveals that the aggregate error asymptotically follows a Gaussian distribution, and the number of selected devices approximates a symmetrical distribution. The distribution parameters are explicitly expressed by the transmit power, the numbers of devices and selected devices. Simulation results confirm the theoretical analysis and demonstrate the effectiveness of the proposed random aggregate beamforming scheme.
引用
收藏
页码:34325 / 34336
页数:12
相关论文
共 50 条
  • [1] Joint Beamforming and Learning Rate Optimization for Over-the-Air Federated Learning
    Kim, Minsik
    Park, Daeyoung
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (10) : 13706 - 13711
  • [2] Beamforming Vector Design and Device Selection in Over-the-Air Federated Learning
    Kim, Minsik
    Swindlehurst, A. Lee
    Park, Daeyoung
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (11) : 7464 - 7477
  • [3] Beamforming and Device Selection Design in Federated Learning With Over-the-Air Aggregation
    Kalarde, Faeze Moradi
    Dong, Min
    Liang, Ben
    Ahmed, Yahia A. Eldemerdash
    Cheng, Ho Ting
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 1710 - 1723
  • [4] Power Minimization in Federated Learning with Over-the-air Aggregation and Receiver Beamforming
    Kalarde, Faeze Moradi
    Liang, Ben
    Dong, Min
    Ahmed, Yahia A. Eldemerdash
    Cheng, Ho Ting
    PROCEEDINGS OF THE INT'L ACM CONFERENCE ON MODELING, ANALYSIS AND SIMULATION OF WIRELESS AND MOBILE SYSTEMS, MSWIM 2023, 2023, : 259 - 267
  • [5] Federated Learning in Wireless Networks via Over-the-Air Computations
    Oksuz, Halil Yigit
    Molinari, Fabio
    Sprekeler, Henning
    Raisch, Joerg
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 4379 - 4386
  • [6] Over-the-Air Federated Graph Learning
    Wang, Zixin
    Zhou, Yong
    Shi, Yuanming
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 18669 - 18683
  • [7] Over-the-Air Clustered Federated Learning
    Sami, Hasin Us
    Guler, Basak
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7877 - 7893
  • [8] Federated Learning Over-the-Air by Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (12) : 9143 - 9156
  • [9] Over-the-Air Decentralized Federated Learning
    Shi, Yandong
    Zhou, Yong
    Shi, Yuanming
    2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 455 - 460
  • [10] Over-the-Air Federated Learning with Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 291 - 295