One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning

被引:2
|
作者
Zhu, Guangxu [1 ]
Du, Yuqing [2 ]
Gunduz, Deniz [3 ]
Huang, Kaibin [2 ]
机构
[1] Shenzhen Res Inst Big Data, Shenzhen, Peoples R China
[2] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[3] Imperial Coll London, Dept Elect & Elect Engn, London, England
基金
国家重点研发计划; 欧洲研究理事会; 中国国家自然科学基金;
关键词
D O I
10.1109/GLOBECOM42002.2020.9322334
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To mitigate the multi-access latency in federated edge learning, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients via the waveform-superposition property of the wireless medium. However. the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation. The new scheme features one-bit gradient quantization followed by digital modulation at the edge devices and a simple threshold-based decoding at the edge server. We develop a comprehensive analysis framework for quantifying the effects of wireless channel hostilities (channel noise and fading) on the convergence rate. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, all the negative effects vanish as the number of devices grows, but at a different rate for each type of channel hostility.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis
    Zhu, Guangxu
    Du, Yuqing
    Gunduz, Deniz
    Huang, Kaibin
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (03) : 2120 - 2135
  • [2] One-Bit Aggregation for Over-the-Air Federated Learning Against Byzantine Attacks
    Miao, Yifan
    Ni, Wanli
    Tian, Hui
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1024 - 1028
  • [3] Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning
    Qiao, Li
    Gao, Zhen
    Mashhadi, Mahdi Boloursaz
    Gunduz, Deniz
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2024, 42 (11) : 3078 - 3094
  • [4] Communication-Efficient Decentralized Federated Learning via One-Bit Compressive Sensing
    Zhou, Shenglong
    Xu, Kaidi
    Li, Geoffrey Ye
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [5] Base Station Dataset-Assisted Broadband Over-the-Air Aggregation for Communication-Efficient Federated Learning
    Hong, Jun-Pyo
    Park, Sangjun
    Choi, Wan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (11) : 7259 - 7272
  • [6] Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning
    Jiang, Bingqing
    Du, Jun
    Jiang, Chunxiao
    Shi, Yuanming
    Han, Zhu
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 173 - 178
  • [7] Communication-Efficient and Secure Federated Learning Based on Adaptive One-Bit Compressed Sensing
    Xiao, Di
    Tan, Xue
    Li, Min
    INFORMATION SECURITY, ISC 2022, 2022, 13640 : 491 - 508
  • [8] Communication-Efficient Federated Learning: A Second Order Newton-Type Method With Analog Over-the-Air Aggregation
    Krouka, Mounssif
    Elgabli, Anis
    Ben Issaid, Chaouki
    Bennis, Mehdi
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2022, 6 (03): : 1862 - 1874
  • [9] Communication-and-Energy Efficient Over-the-Air Federated Learning
    Liang, Yipeng
    Chen, Qimei
    Zhu, Guangxu
    Jiang, Hao
    Eldar, Yonina C.
    Cui, Shuguang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2025, 24 (01) : 767 - 782
  • [10] Communication-Efficient Secure Aggregation for Federated Learning
    Ergun, Irem
    Sami, Hasin Us
    Guler, Basak
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3881 - 3886