Communication-Efficient Personalized Federated Meta-Learning in Edge Networks

被引:10
|
作者
Yu, Feng [1 ,2 ]
Lin, Hui [1 ,2 ]
Wang, Xiaoding [1 ,2 ]
Garg, Sahil [3 ]
Kaddoum, Georges [3 ,4 ]
Singh, Satinder [5 ]
Hassan, Mohammad Mehedi [6 ]
机构
[1] Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
[2] Fujian Prov Univ, Engn Res Ctr Cyber Secur & Educ Informatizat, Fuzhou 350117, Fujian, Peoples R China
[3] Ecole Technol Super, Montreal, PQ H3C 1K3, Canada
[4] Lebanese Amer Univ, Cyber Secur Syst & Appl AI Res Ctr, Beirut, Lebanon
[5] Ultra Commun, Montreal, PQ H4T 1V7, Canada
[6] King Saud Univ, Coll Comp & Informat Sci, Dept Informat Syst, Riyadh 11543, Saudi Arabia
关键词
Edge networks; federated meta learning; representation learning; autoencoder; differential privacy;
D O I
10.1109/TNSM.2023.3263831
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the privacy breach risks and data aggregation of traditional centralized machine learning (ML) approaches, applications, data and computing power are being pushed from centralized data centers to network edge nodes. Federated Learning (FL) is an emerging privacy-preserving distributed ML paradigm suitable for edge network applications, which is able to address the above two issues of traditional ML. However, the current FL methods cannot flexibly deal with the challenges of model personalization and communication overhead in the network applications. Inspired by the mixture of global and local models, we proposed a Communication-Efficient Personalized Federated Meta-Learning algorithm to obtain a novel personalized model by introducing the personalization parameter. We can improve model accuracy and accelerate its convergence by adjusting the size of the personalized parameter. Further, the local model to be uploaded is transformed into the latent space through autoencoder, thereby reducing the amount of communication data, and further reducing communication overhead. And local and task-global differential privacy are applied to provide privacy protection for model generation. Simulation experiments demonstrate that our method can obtain better personalized models at a lower communication overhead for edge network applications, while compared with several other algorithms.
引用
收藏
页码:1558 / 1571
页数:14
相关论文
共 50 条
  • [1] LotteryFL: Empower Edge Intelligence with Personalized and Communication-Efficient Federated Learning
    Li, Ang
    Sun, Jingwei
    Wang, Binghui
    Duan, Lin
    Li, Sicheng
    Chen, Yiran
    Li, Hai
    2021 ACM/IEEE 6TH SYMPOSIUM ON EDGE COMPUTING (SEC 2021), 2021, : 68 - 79
  • [2] Communication-Efficient Personalized Federated Edge Learning for Decentralized Sensing in ISAC
    Zhu, Yonghui
    Zhang, Ronghui
    Cui, Yuanhao
    Wu, Sheng
    Jiang, Chunxiao
    Jing, Xiaojun
    2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 207 - 212
  • [3] Communication-Efficient Personalized Federated Edge Learning for Massive MIMO CSI Feedback
    Cui, Yiming
    Guo, Jiajia
    Wen, Chao-Kai
    Jin, Shi
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7362 - 7375
  • [4] Communication-Efficient and Personalized Federated Lottery Ticket Learning
    Seo, Sejin
    Ko, Seung-Woo
    Park, Jihong
    Kim, Seong-Lyun
    Bennis, Mehdi
    SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 581 - 585
  • [5] Communication-efficient and Scalable Decentralized Federated Edge Learning
    Yapp, Austine Zong Han
    Koh, Hong Soo Nicholas
    Lai, Yan Ting
    Kang, Jiawen
    Li, Xuandi
    Ng, Jer Shyuan
    Jiang, Hongchao
    Lim, Wei Yang Bryan
    Xiong, Zehui
    Niyato, Dusit
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 5032 - 5035
  • [6] Communication-Efficient Federated Learning for Digital Twin Edge Networks in Industrial IoT
    Lu, Yunlong
    Huang, Xiaohong
    Zhang, Ke
    Maharjan, Sabita
    Zhang, Yan
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (08) : 5709 - 5718
  • [7] Communication-Efficient Federated Learning and Permissioned Blockchain for Digital Twin Edge Networks
    Lu, Yunlong
    Huang, Xiaohong
    Zhang, Ke
    Maharjan, Sabita
    Zhang, Yan
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) : 2276 - 2288
  • [8] Communication-efficient federated learning via personalized filter pruning
    Min, Qi
    Luo, Fei
    Dong, Wenbo
    Gu, Chunhua
    Ding, Weichao
    INFORMATION SCIENCES, 2024, 678
  • [9] Communication-Efficient Personalized Federated Learning for Green Communications in IoMT
    Chen, Ziqi
    Du, Jun
    Jiang, Chunxiao
    Lu, Yunlong
    Han, Zhu
    ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, : 1521 - 1526
  • [10] Byzantine-Robust and Communication-Efficient Personalized Federated Learning
    Zhang, Jiaojiao
    He, Xuechao
    Huang, Yue
    Ling, Qing
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2025, 73 : 26 - 39