Communication-Efficient Personalized Federated Meta-Learning in Edge Networks

被引:10
|
作者
Yu, Feng [1 ,2 ]
Lin, Hui [1 ,2 ]
Wang, Xiaoding [1 ,2 ]
Garg, Sahil [3 ]
Kaddoum, Georges [3 ,4 ]
Singh, Satinder [5 ]
Hassan, Mohammad Mehedi [6 ]
机构
[1] Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
[2] Fujian Prov Univ, Engn Res Ctr Cyber Secur & Educ Informatizat, Fuzhou 350117, Fujian, Peoples R China
[3] Ecole Technol Super, Montreal, PQ H3C 1K3, Canada
[4] Lebanese Amer Univ, Cyber Secur Syst & Appl AI Res Ctr, Beirut, Lebanon
[5] Ultra Commun, Montreal, PQ H4T 1V7, Canada
[6] King Saud Univ, Coll Comp & Informat Sci, Dept Informat Syst, Riyadh 11543, Saudi Arabia
关键词
Edge networks; federated meta learning; representation learning; autoencoder; differential privacy;
D O I
10.1109/TNSM.2023.3263831
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the privacy breach risks and data aggregation of traditional centralized machine learning (ML) approaches, applications, data and computing power are being pushed from centralized data centers to network edge nodes. Federated Learning (FL) is an emerging privacy-preserving distributed ML paradigm suitable for edge network applications, which is able to address the above two issues of traditional ML. However, the current FL methods cannot flexibly deal with the challenges of model personalization and communication overhead in the network applications. Inspired by the mixture of global and local models, we proposed a Communication-Efficient Personalized Federated Meta-Learning algorithm to obtain a novel personalized model by introducing the personalization parameter. We can improve model accuracy and accelerate its convergence by adjusting the size of the personalized parameter. Further, the local model to be uploaded is transformed into the latent space through autoencoder, thereby reducing the amount of communication data, and further reducing communication overhead. And local and task-global differential privacy are applied to provide privacy protection for model generation. Simulation experiments demonstrate that our method can obtain better personalized models at a lower communication overhead for edge network applications, while compared with several other algorithms.
引用
收藏
页码:1558 / 1571
页数:14
相关论文
共 50 条
  • [21] Personalized Learning with Limited Data on Edge Devices using Federated Learning and Meta-Learning
    Voleti, Kousalya Soumya Lahari
    Ho, Shen-Shyang
    2023 IEEE/ACM SYMPOSIUM ON EDGE COMPUTING, SEC 2023, 2023, : 378 - 382
  • [22] Communication-Efficient Federated Multitask Learning Over Wireless Networks
    Ma, Haoyu
    Guo, Huayan
    Lau, Vincent K. N.
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (01) : 609 - 624
  • [23] Communication-Efficient Federated Learning for Resource-Constrained Edge Devices
    Lan, Guangchen
    Liu, Xiao-Yang
    Zhang, Yijing
    Wang, Xiaodong
    IEEE Transactions on Machine Learning in Communications and Networking, 2023, 1 : 210 - 224
  • [24] Toward Communication-Efficient Federated Learning in the Internet of Things With Edge Computing
    Sun, Haifeng
    Li, Shiqi
    Yu, F. Richard
    Qi, Qi
    Wang, Jingyu
    Liao, Jianxin
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (11) : 11053 - 11067
  • [25] Communication-Efficient Vertical Federated Learning
    Khan, Afsana
    ten Thij, Marijn
    Wilbik, Anna
    ALGORITHMS, 2022, 15 (08)
  • [26] Communication-Efficient Adaptive Federated Learning
    Wang, Yujia
    Lin, Lu
    Chen, Jinghui
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [27] Communication-Efficient Personalized Federated Learning for Digital Twin in Heterogeneous Industrial IoT
    Wang, Zhihan
    Ma, Xiangxue
    Zhang, Haixia
    Yuan, Dongfeng
    2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 237 - 241
  • [28] Personalized Federated Learning with Contextual Modulation and Meta-Learning
    Vettoruzzo, Anna
    Bouguelia, Mohamed-Rafik
    Rognvaldsson, Thorsteinn
    PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, : 842 - 850
  • [29] Communication-efficient Federated Learning for UAV Networks with Knowledge Distillation and Transfer Learning
    Li, Yalong
    Wu, Celimuge
    Du, Zhaoyang
    Zhong, Lei
    Yoshinaga, Tsutomu
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5739 - 5744
  • [30] Efficient Wireless Traffic Prediction at the Edge: A Federated Meta-Learning Approach
    Zhang, Liang
    Zhang, Chuanting
    Shihada, Basem
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (07) : 1573 - 1577