Robust Asynchronous Federated Learning With Time-Weighted and Stale Model Aggregation

被引:2
|
作者
Miao, Yinbin [1 ]
Liu, Ziteng [1 ]
Li, Xinghua [2 ,3 ]
Li, Meng [4 ]
Li, Hongwei [5 ]
Choo, Kim-Kwang Raymond [6 ]
Deng, Robert H. [7 ]
机构
[1] Xidian Univ, Sch Cyber Engn, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Xidian Univ, Engn Res Ctr Big data Secur, Minist Educ, Xian 710071, Peoples R China
[4] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230002, Peoples R China
[5] Univ Elect Sci & Technol China, Dept Comp Sci & Engn, Chengdu 610051, Peoples R China
[6] Univ Texas San Antonio, Dept Informat Syst & Cyber Secur, San Antonio, TX 78249 USA
[7] Singapore Management Univ, Sch Informat Syst, Singapore 178902, Singapore
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Privacy; Computational modeling; Training; Federated learning; Servers; Homomorphic encryption; Convergence; heterogeneity; symmetric homomorphic encryption; privacy; lightweight computing;
D O I
10.1109/TDSC.2023.3304788
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) ensures collaborative learning among multiple clients while maintaining data locally. However, the traditional synchronous FL solutions have lower accuracy and require more communication time in scenarios where most devices drop out during learning. Therefore, we propose an Asynchronous Federated Learning (AsyFL) scheme using time-weighted and stale model aggregation, which effectively solves the problem of poor model performance due to the heterogeneity of devices. Then, we integrate Symmetric Homomorphic Encryption (SHE) into AsyFL to propose Asynchronous Privacy-Preserving Federated Learning (Asy-PPFL), which protects the privacy of clients and achieves lightweight computing. Privacy analysis shows that Asy-PPFL is indistinguishable under Known Plaintext Attack (KPA) and convergence analysis proves the effectiveness of our schemes. A large number of experiments show that AsyFL and Asy-PPFL can achieve the highest accuracy of 58.40% and 58.26% on Cifar-10 dataset when most clients (i.e., 80%) are offline or delayed, respectively.
引用
收藏
页码:2361 / 2375
页数:15
相关论文
共 50 条
  • [31] Just-in-Time Aggregation for Federated Learning
    Jayaram, K. R.
    Verma, Ashish
    Thomas, Gegi
    Muthusamy, Vinod
    2022 30TH INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS, AND SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS, MASCOTS, 2022, : 1 - 8
  • [32] A Privacy Robust Aggregation Method Based on Federated Learning in the IoT
    Li, Qingtie
    Wang, Xuemei
    Ren, Shougang
    ELECTRONICS, 2023, 12 (13)
  • [33] Privacy Preservation for Federated Learning With Robust Aggregation in Edge Computing
    Liu, Wentao
    Xu, Xiaolong
    Li, Dejuan
    Qi, Lianyong
    Dai, Fei
    Dou, Wanchun
    Ni, Qiang
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (08) : 7343 - 7355
  • [34] Amplitude-Aligned Personalization and Robust Aggregation for Federated Learning
    Jiang, Yongqi
    Chen, Siguang
    Bao, Xiangwen
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2024, 9 (03): : 535 - 547
  • [35] Shielding Federated Learning: Robust Aggregation with Adaptive Client Selection
    Wan, Wei
    Hu, Shengshan
    Lu, Jianrong
    Zhang, Leo Yu
    Jin, Hai
    He, Yuanyuan
    PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, 2022, : 753 - 760
  • [36] Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing
    Sha, Xiaobao
    Sun, Wenjian
    Liu, Xiang
    Luo, Yang
    Luo, Chunbo
    ELECTRONICS, 2024, 13 (11)
  • [37] Toward Secure Weighted Aggregation for Privacy-Preserving Federated Learning
    He, Yunlong
    Yu, Jia
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 3475 - 3488
  • [38] Fast-convergent federated learning with class-weighted aggregation
    Ma, Zezhong
    Zhao, Mengying
    Cai, Xiaojun
    Jia, Zhiping
    Journal of Systems Architecture, 2021, 117
  • [39] Computationally Efficient Auto-Weighted Aggregation for Heterogeneous Federated Learning
    Talukder, Zahidur
    Islam, Mohammad A.
    2022 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING & COMMUNICATIONS (IEEE EDGE 2022), 2022, : 12 - 22
  • [40] Fast-convergent federated learning with class-weighted aggregation
    Ma, Zezhong
    Zhao, Mengying
    Cai, Xiaojun
    Jia, Zhiping
    JOURNAL OF SYSTEMS ARCHITECTURE, 2021, 117