FedASA: A Personalized Federated Learning With Adaptive Model Aggregation for Heterogeneous Mobile Edge Computing

被引:2
|
作者
Deng, Dongshang [1 ,2 ]
Wu, Xuangou [1 ,2 ]
Zhang, Tao [3 ,4 ]
Tang, Xiangyun [5 ]
Du, Hongyang [6 ]
Kang, Jiawen [7 ]
Liu, Jiqiang [8 ]
Niyato, Dusit [9 ]
机构
[1] Anhui Univ Technol, Sch Comp Sci & Technol, Maanshan 243002, Peoples R China
[2] Anhui Prov Key Lab Digital Twin Technol Met Ind, Maanshan 243002, Peoples R China
[3] Beijing Jiaotong Univ, Sch Cyberspace Sci & Technol, Beijing 100044, Peoples R China
[4] Anhui Engn Res Ctr Intelligent Applicat & Secur In, Beijing 100044, Peoples R China
[5] Minzu Univ China, Sch Informat Engn, Beijing 100081, Peoples R China
[6] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[7] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[8] Beijing Jiaotong Univ, Sch Cyberspace Sci & Technol, Beijing 100044, Peoples R China
[9] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
基金
中国博士后科学基金; 新加坡国家研究基金会;
关键词
Computational modeling; Performance evaluation; Adaptation models; Accuracy; Servers; Internet of Things; Computer architecture; mobile edge computing; personalized federated learning; resource constraint; statistical heterogeneity;
D O I
10.1109/TMC.2024.3446271
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) opens a new promising paradigm for the Industrial Internet of Things (IoT) since it can collaboratively train machine learning models without sharing private data. However, deploying FL frameworks in real IoT scenarios faces three critical challenges, i.e., statistical heterogeneity, resource constraint, and fairness. To address these challenges, we design a fair and efficient FL method, termed FedASA, which can address the challenge of statistical heterogeneity in resource-constrained scenarios by determining the shared architecture adaptively. In FedASA, we first present a cell-wised shared architecture selection strategy, which can adaptively construct the shared architecture for each device. We then design a cell-based aggregation algorithm for aggregating heterogeneous shared architectures. In addition, we provide a theoretical analysis of the federated error bound, which provides a theoretical guarantee for the fairness. At the same time, we prove the convergence of FedASA at the first-order stationary point. We evaluate the performance of FedASA through extensive simulation and experiments. Experimental results in cross-location scenarios show that FedASA outperformed the state-of-the-art approaches, improving accuracy by up to 13.27% with better fairness and faster convergence and communication requirement has been reduced by 81.49%.
引用
收藏
页码:14787 / 14802
页数:16
相关论文
共 50 条
  • [1] FedMEM: Adaptive Personalized Federated Learning Framework for Heterogeneous Mobile Edge Environments
    Chen Ximing
    He Xilong
    Cheng Du
    Wu Tiejun
    Tian Qingyu
    Chen Rongrong
    Qiu Jing
    International Journal of Computational Intelligence Systems, 18 (1)
  • [2] Equalized Aggregation for Heterogeneous Federated Mobile Edge Learning
    Yang, Zhao
    Zhang, Shengbing
    Li, Chuxi
    Wang, Miao
    Yang, Jiaying
    Zhang, Meng
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 3558 - 3575
  • [3] FedMP: Federated Learning through Adaptive Model Pruning in Heterogeneous Edge Computing
    Jiang, Zhida
    Xu, Yang
    Xu, Hongli
    Wang, Zhiyuan
    Qiao, Chunming
    Zhao, Yangming
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 767 - 779
  • [4] APCSMA: Adaptive Personalized Client-Selection and Model-Aggregation Algorithm for Federated Learning in Edge Computing Scenarios
    Ma, Xueting
    Ma, Guorui
    Liu, Yang
    Qi, Shuhan
    ENTROPY, 2024, 26 (08)
  • [5] Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing
    Biyao Gong
    Tianzhang Xing
    Zhidan Liu
    Junfeng Wang
    Xiuya Liu
    Mobile Networks and Applications, 2022, 27 : 1520 - 1530
  • [6] Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing
    Gong, Biyao
    Xing, Tianzhang
    Liu, Zhidan
    Wang, Junfeng
    Liu, Xiuya
    Mobile Networks and Applications, 2022, 27 (04): : 1520 - 1530
  • [7] Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing
    Gong, Biyao
    Xing, Tianzhang
    Liu, Zhidan
    Wang, Junfeng
    Liu, Xiuya
    MOBILE NETWORKS & APPLICATIONS, 2022, 27 (04): : 1520 - 1530
  • [8] FedAda: Fast-convergent adaptive federated learning in heterogeneous mobile edge computing environment
    Jinghui Zhang
    Xinyu Cheng
    Cheng Wang
    Yuchen Wang
    Zhan Shi
    Jiahui Jin
    Aibo Song
    Wei Zhao
    Liangsheng Wen
    Tingting Zhang
    World Wide Web, 2022, 25 : 1971 - 1998
  • [9] FedAda: Fast-convergent adaptive federated learning in heterogeneous mobile edge computing environment
    Zhang, Jinghui
    Cheng, Xinyu
    Wang, Cheng
    Wang, Yuchen
    Shi, Zhan
    Jin, Jiahui
    Song, Aibo
    Zhao, Wei
    Wen, Liangsheng
    Zhang, Tingting
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2022, 25 (05): : 1971 - 1998
  • [10] Accelerating federated learning based on grouping aggregation in heterogeneous edge computing
    Li, Long
    Li, Chao
    6TH INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE, ICIAI2022, 2022, : 19 - 22