Robust Asynchronous Federated Learning With Time-Weighted and Stale Model Aggregation

被引:2
|
作者
Miao, Yinbin [1 ]
Liu, Ziteng [1 ]
Li, Xinghua [2 ,3 ]
Li, Meng [4 ]
Li, Hongwei [5 ]
Choo, Kim-Kwang Raymond [6 ]
Deng, Robert H. [7 ]
机构
[1] Xidian Univ, Sch Cyber Engn, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Xidian Univ, Engn Res Ctr Big data Secur, Minist Educ, Xian 710071, Peoples R China
[4] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230002, Peoples R China
[5] Univ Elect Sci & Technol China, Dept Comp Sci & Engn, Chengdu 610051, Peoples R China
[6] Univ Texas San Antonio, Dept Informat Syst & Cyber Secur, San Antonio, TX 78249 USA
[7] Singapore Management Univ, Sch Informat Syst, Singapore 178902, Singapore
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Privacy; Computational modeling; Training; Federated learning; Servers; Homomorphic encryption; Convergence; heterogeneity; symmetric homomorphic encryption; privacy; lightweight computing;
D O I
10.1109/TDSC.2023.3304788
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) ensures collaborative learning among multiple clients while maintaining data locally. However, the traditional synchronous FL solutions have lower accuracy and require more communication time in scenarios where most devices drop out during learning. Therefore, we propose an Asynchronous Federated Learning (AsyFL) scheme using time-weighted and stale model aggregation, which effectively solves the problem of poor model performance due to the heterogeneity of devices. Then, we integrate Symmetric Homomorphic Encryption (SHE) into AsyFL to propose Asynchronous Privacy-Preserving Federated Learning (Asy-PPFL), which protects the privacy of clients and achieves lightweight computing. Privacy analysis shows that Asy-PPFL is indistinguishable under Known Plaintext Attack (KPA) and convergence analysis proves the effectiveness of our schemes. A large number of experiments show that AsyFL and Asy-PPFL can achieve the highest accuracy of 58.40% and 58.26% on Cifar-10 dataset when most clients (i.e., 80%) are offline or delayed, respectively.
引用
收藏
页码:2361 / 2375
页数:15
相关论文
共 50 条
  • [41] Time Efficient Federated Learning with Semi-asynchronous Communication
    Hao, Jiangshan
    Zhao, Yanchao
    Zhang, Jiale
    2020 IEEE 26TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2020, : 156 - 163
  • [42] IMPROVED RECOMMENDATION ALGORITHM RESEARCH BASED ON CLOUD MODEL AND TIME-WEIGHTED
    Han Lixia
    Gao Ling
    Yang Feifei
    FOURTH INTERNATIONAL CONFERENCE ON COMPUTER AND ELECTRICAL ENGINEERING (ICCEE 2011), 2011, : 129 - +
  • [43] DWFed: A statistical- heterogeneity-based dynamic weighted model aggregation algorithm for federated learning
    Chen, Aiguo
    Fu, Yang
    Wang, Lingfu
    Duan, Guiduo
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [44] Improving Federated Learning With Quality-Aware User Incentive and Auto-Weighted Model Aggregation
    Deng, Yongheng
    Lyu, Feng
    Ren, Ju
    Chen, Yi-Chao
    Yang, Peng
    Zhou, Yuezhi
    Zhang, Yaoxue
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 4515 - 4529
  • [45] Towards Efficient and Stable K-Asynchronous Federated Learning With Unbounded Stale Gradients on Non-IID Data
    Zhou, Zihao
    Li, Yanan
    Ren, Xuebin
    Yang, Shusen
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 3291 - 3305
  • [46] DWFed: A statistical- heterogeneity-based dynamic weighted model aggregation algorithm for federated learning
    Chen, Aiguo
    Fu, Yang
    Wang, Lingfu
    Duan, Guiduo
    Frontiers in Neurorobotics, 2022, 16
  • [47] Robust time-weighted guaranteed cost control of uncertain periodic piecewise linear systems
    Xie, Xiaochen
    Lam, James
    Fan, Chenchen
    INFORMATION SCIENCES, 2018, 460 : 238 - 253
  • [48] Robust Federated Learning for Heterogeneous Model and Data
    Madni, Hussain Ahmad
    Umer, Rao Muhammad
    Foresti, Gian Luca
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2024, 34 (04)
  • [49] Time-weighted LSTM Model with Redefined Labeling for Stock Trend Prediction
    Zhao, Zhiyong
    Rao, Ruonan
    Tu, Shaoxiong
    Shi, Jun
    2017 IEEE 29TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2017), 2017, : 1210 - 1217
  • [50] ADAPTIVE MODEL AGGREGATION IN FEDERATED LEARNING BASED ON MODEL ACCURACY
    Wang, Rebekah
    Chen, Yingying
    IEEE WIRELESS COMMUNICATIONS, 2024, : 1 - 7