Knowledge-Aware Parameter Coaching for Communication-Efficient Personalized Federated Learning in Mobile Edge Computing

被引:0
|
作者
Zhi, Mingjian [1 ]
Bi, Yuanguo [1 ]
Cai, Lin [2 ]
Xu, Wenchao [3 ]
Wang, Haozhao [4 ]
Xiang, Tianao [1 ]
He, Qiang [5 ]
机构
[1] Northeastem Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
[2] Univ Victoria, Dept Elect & Comp Engn, Victoria, BC V8W3P6, Canada
[3] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[4] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
[5] Northeastern Univ, Sch Med & Biol Informat Engn, Shenyang 110169, Peoples R China
基金
中国国家自然科学基金;
关键词
Servers; Training; Computational modeling; Adaptation models; Federated learning; Data models; Costs; Communication optimization; federated learning; mobile edge computing; personalization;
D O I
10.1109/TMC.2024.3464512
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Personalized Federated Learning (pFL) can improve the accuracy of local models and provide enhanced edge intelligence without exposing the raw data in Mobile Edge Computing (MEC). However, in the MEC environment with constrained communication resources, transmitting the entire model between the server and the clients in traditional pFL methods imposes substantial communication overhead, which can lead to inaccurate personalization and degraded performance of mobile clients. In response, we propose a Communication-Efficient pFL architecture to enhance the performance of personalized models while minimizing communication overhead in MEC. First, a Knowledge-Aware Parameter Coaching method (KAPC) is presented to produce a more accurate personalized model by utilizing the layer-wise parameters of other clients with adaptive aggregation weights. Then, convergence analysis of the proposed KAPC is developed in both the convex and non-convex settings. Second, a Bidirectional Layer Selection algorithm (BLS) based on self-relationship and generalization error is proposed to select the most informative layers for transmission, which reduces communication costs. Extensive experiments are conducted, and the results demonstrate that the proposed KAPC achieves superior accuracy compared to the state-of-the-art baselines, while the proposed BLS substantially improves resource utilization without sacrificing performance.
引用
收藏
页码:321 / 337
页数:17
相关论文
共 50 条
  • [1] Knowledge-Aware Parameter Coaching for Personalized Federated Learning
    Zhi, Mingjian
    Bi, Yuanguo
    Xu, Wenchao
    Wang, Haozhao
    Xiang, Tianao
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 17069 - 17077
  • [2] Communication-Efficient and Byzantine-Robust Federated Learning for Mobile Edge Computing Networks
    Zhang, Zhuangzhuang
    Wl, Libing
    He, Debiao
    Li, Jianxin
    Cao, Shuqin
    Wu, Xianfeng
    IEEE NETWORK, 2023, 37 (04): : 112 - 119
  • [3] Coded Federated Learning for Communication-Efficient Edge Computing: A Survey
    Zhang, Yiqian
    Gao, Tianli
    Li, Congduan
    Tan, Chee Wei
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 4098 - 4124
  • [4] FedSAUC: A Similarity-Aware Update Control for Communication-Efficient Federated Learning in Edge Computing
    Lee, Ming-Lun
    Chou, Han-Chang
    Chen, Yan-Ann
    13TH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORK (ICMU2021), 2021,
  • [5] LotteryFL: Empower Edge Intelligence with Personalized and Communication-Efficient Federated Learning
    Li, Ang
    Sun, Jingwei
    Wang, Binghui
    Duan, Lin
    Li, Sicheng
    Chen, Yiran
    Li, Hai
    2021 ACM/IEEE 6TH SYMPOSIUM ON EDGE COMPUTING (SEC 2021), 2021, : 68 - 79
  • [6] Communication-Efficient Personalized Federated Edge Learning for Decentralized Sensing in ISAC
    Zhu, Yonghui
    Zhang, Ronghui
    Cui, Yuanhao
    Wu, Sheng
    Jiang, Chunxiao
    Jing, Xiaojun
    2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 207 - 212
  • [7] Communication-Efficient Personalized Federated Meta-Learning in Edge Networks
    Yu, Feng
    Lin, Hui
    Wang, Xiaoding
    Garg, Sahil
    Kaddoum, Georges
    Singh, Satinder
    Hassan, Mohammad Mehedi
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (02): : 1558 - 1571
  • [8] Toward Communication-Efficient Federated Learning in the Internet of Things With Edge Computing
    Sun, Haifeng
    Li, Shiqi
    Yu, F. Richard
    Qi, Qi
    Wang, Jingyu
    Liao, Jianxin
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (11) : 11053 - 11067
  • [9] Communication-Efficient Personalized Federated Edge Learning for Massive MIMO CSI Feedback
    Cui, Yiming
    Guo, Jiajia
    Wen, Chao-Kai
    Jin, Shi
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7362 - 7375
  • [10] Communication-efficient asynchronous federated learning in resource-constrained edge computing
    Liu, Jianchun
    Xu, Hongli
    Xu, Yang
    Ma, Zhenguo
    Wang, Zhiyuan
    Qian, Chen
    Huang, He
    COMPUTER NETWORKS, 2021, 199