Knowledge-Aware Parameter Coaching for Communication-Efficient Personalized Federated Learning in Mobile Edge Computing

被引:0
|
作者
Zhi, Mingjian [1 ]
Bi, Yuanguo [1 ]
Cai, Lin [2 ]
Xu, Wenchao [3 ]
Wang, Haozhao [4 ]
Xiang, Tianao [1 ]
He, Qiang [5 ]
机构
[1] Northeastem Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
[2] Univ Victoria, Dept Elect & Comp Engn, Victoria, BC V8W3P6, Canada
[3] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[4] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
[5] Northeastern Univ, Sch Med & Biol Informat Engn, Shenyang 110169, Peoples R China
基金
中国国家自然科学基金;
关键词
Servers; Training; Computational modeling; Adaptation models; Federated learning; Data models; Costs; Communication optimization; federated learning; mobile edge computing; personalization;
D O I
10.1109/TMC.2024.3464512
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Personalized Federated Learning (pFL) can improve the accuracy of local models and provide enhanced edge intelligence without exposing the raw data in Mobile Edge Computing (MEC). However, in the MEC environment with constrained communication resources, transmitting the entire model between the server and the clients in traditional pFL methods imposes substantial communication overhead, which can lead to inaccurate personalization and degraded performance of mobile clients. In response, we propose a Communication-Efficient pFL architecture to enhance the performance of personalized models while minimizing communication overhead in MEC. First, a Knowledge-Aware Parameter Coaching method (KAPC) is presented to produce a more accurate personalized model by utilizing the layer-wise parameters of other clients with adaptive aggregation weights. Then, convergence analysis of the proposed KAPC is developed in both the convex and non-convex settings. Second, a Bidirectional Layer Selection algorithm (BLS) based on self-relationship and generalization error is proposed to select the most informative layers for transmission, which reduces communication costs. Extensive experiments are conducted, and the results demonstrate that the proposed KAPC achieves superior accuracy compared to the state-of-the-art baselines, while the proposed BLS substantially improves resource utilization without sacrificing performance.
引用
收藏
页码:321 / 337
页数:17
相关论文
共 50 条
  • [41] FlocOff: Data Heterogeneity Resilient Federated Learning With Communication-Efficient Edge Offloading
    Ma, Mulei
    Gong, Chenyu
    Zeng, Liekang
    Yang, Yang
    Wu, Liantao
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2024, 42 (11) : 3262 - 3277
  • [42] Mobile Edge Computing Enabled Efficient Communication Based on Federated Learning in Internet of Medical Things
    Zheng, Xiao
    Shah, Syed Bilal Hussain
    Ren, Xiaojun
    Li, Fengqi
    Nawaf, Liqaa
    Chakraborty, Chinmay
    Fayaz, Muhammad
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [43] Communication-Efficient Federated Edge Learning via Optimal Probabilistic Device Scheduling
    Zhang, Maojun
    Zhu, Guangxu
    Wang, Shuai
    Jiang, Jiamo
    Liao, Qing
    Zhong, Caijun
    Cui, Shuguang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (10) : 8536 - 8551
  • [44] SHARE: Shaping Data Distribution at Edge for Communication-Efficient Hierarchical Federated Learning
    Deng, Yongheng
    Lyu, Feng
    Ren, Ju
    Zhang, Yongmin
    Zhou, Yuezhi
    Zhang, Yaoxue
    Yang, Yuanyuan
    2021 IEEE 41ST INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2021), 2021, : 24 - 34
  • [45] Communication-Efficient Federated Learning for Digital Twin Edge Networks in Industrial IoT
    Lu, Yunlong
    Huang, Xiaohong
    Zhang, Ke
    Maharjan, Sabita
    Zhang, Yan
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (08) : 5709 - 5718
  • [46] HPFL-CN: Communication-Efficient Hierarchical Personalized Federated Edge Learning via Complex Network Feature Clustering
    Li, Zijian
    Chen, Zihan
    Wei, Xiaohui
    Gao, Shang
    Ren, Chenghao
    Quek, Tony Q. S.
    2022 19TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2022, : 325 - 333
  • [47] Communication-Efficient Federated Learning with Heterogeneous Devices
    Chen, Zhixiong
    Yi, Wenqiang
    Liu, Yuanwei
    Nallanathan, Arumugam
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 3602 - 3607
  • [48] Knowledge-Aware Multispace Embedding Learning for Personalized Recommendation
    Jian, Meng
    Zhang, Chenlin
    Fu, Xin
    Wu, Lifang
    Wang, Zhangquan
    SENSORS, 2022, 22 (06)
  • [49] Communication-Efficient Federated Learning for Decision Trees
    Zhao, Shuo
    Zhu, Zikun
    Li, Xin
    Chen, Ying-Chi
    IEEE Transactions on Artificial Intelligence, 2024, 5 (11): : 5478 - 5492
  • [50] Communication-Efficient Federated Learning and Permissioned Blockchain for Digital Twin Edge Networks
    Lu, Yunlong
    Huang, Xiaohong
    Zhang, Ke
    Maharjan, Sabita
    Zhang, Yan
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) : 2276 - 2288