An Adaptive Compression and Communication Framework for Wireless Federated Learning

被引:1
|
作者
Yang, Yang [1 ]
Dang, Shuping [2 ]
Zhang, Zhenrong [1 ]
机构
[1] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Sch Comp & Elect Informat, Nanning, Peoples R China
[2] Univ Bristol, Sch Elect Elect & Mech Engn, Bristol, England
关键词
Convergence; Training; Vectors; Computational modeling; Quantization (signal); Communication system security; Optimization; Federated learning; communication-computing trade-off; distributed machine learning; joint optimization; model compression;
D O I
10.1109/TMC.2024.3382776
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a distributed privacy-preserving paradigm of machine learning that enables efficient and secure model training through the collaboration of multiple clients. However, imperfect channel estimation and resource constraints of edge devices severely hinder the convergence of typical wireless FL, while the trade-off between communications and computation still lacks in-depth exploration. These factors lead to inefficient communications and hinder the full potential of FL from being unleashed. In this regard, we formulate a joint optimization problem of communications and learning in wireless networks subject to dynamic channel variations. For addressing the formulated problem, we propose an integrated adaptive $n$n-ary compression and resource management framework (ANC) that is capable of adjusting the selection of edge devices and compression schemes, and allocates the optimal resource blocks and transmit power to each participating device, which effectively improves the energy efficiency and scalability of FL in resource-constrained environments. Furthermore, an upper bound on the expected global convergence rate is derived in this paper to quantify the impacts of transmitted data volume and wireless propagation on the convergence of FL. Simulation results demonstrate that the proposed adaptive framework achieves much faster convergence while maintaining considerably low communication overhead.
引用
收藏
页码:10835 / 10854
页数:20
相关论文
共 50 条
  • [41] Communication-Efficient Federated Learning with Adaptive Quantization
    Mao, Yuzhu
    Zhao, Zihao
    Yan, Guangfeng
    Liu, Yang
    Lan, Tian
    Song, Linqi
    Ding, Wenbo
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (04)
  • [42] Communication Efficient Federated Learning Framework with Local Momentum
    Xie, Renyou
    Zhou, Xiaojun
    2022 15TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION (HSI), 2022,
  • [43] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 269 - 283
  • [44] FedSwarm: An Adaptive Federated Learning Framework for Scalable AIoT
    Du, Haizhou
    Ni, Chengdong
    Cheng, Chaoqian
    Xiang, Qiao
    Chen, Xi
    Liu, Xue
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (05): : 8268 - 8287
  • [45] BFLP: An Adaptive Federated Learning Framework for Internet of Vehicles
    Peng, Yongqiang
    Chen, Zongyao
    Chen, Zexuan
    Ou, Wei
    Han, Wenbao
    Ma, Jianqiang
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [46] Differentially private federated learning framework with adaptive clipping
    Wang F.
    Xie M.
    Li Q.
    Wang C.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2023, 50 (04): : 111 - 112
  • [47] AdaptFL: Adaptive Federated Learning Framework for Heterogeneous Devices
    Zhang, Yingqi
    Xia, Hui
    Xu, Shuo
    Wang, Xiangxiang
    Xu, Lijuan
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2025, 165
  • [48] AFL: Adaptive Federated Learning Based on Personalized Model and Adaptive Communication
    Wu, Xing
    Liu, Fei Xiang
    Zhao, Yue
    Zhao, Ming
    NEW TRENDS IN INTELLIGENT SOFTWARE METHODOLOGIES, TOOLS AND TECHNIQUES, 2021, 337 : 359 - 366
  • [49] Computation and Communication Efficient Adaptive Federated Optimization of Federated Learning for Internet of Things
    Chen, Zunming
    Cui, Hongyan
    Wu, Ensen
    Yu, Xi
    ELECTRONICS, 2023, 12 (16)
  • [50] Wireless Quantized Federated Learning: A Joint Computation and Communication Design
    Bouzinis, Pavlos S.
    Diamantoulakis, Panagiotis D.
    Karagiannidis, George K.
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (05) : 2756 - 2770