Robust Asynchronous Federated Learning With Time-Weighted and Stale Model Aggregation

被引:2
|
作者
Miao, Yinbin [1 ]
Liu, Ziteng [1 ]
Li, Xinghua [2 ,3 ]
Li, Meng [4 ]
Li, Hongwei [5 ]
Choo, Kim-Kwang Raymond [6 ]
Deng, Robert H. [7 ]
机构
[1] Xidian Univ, Sch Cyber Engn, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Xidian Univ, Engn Res Ctr Big data Secur, Minist Educ, Xian 710071, Peoples R China
[4] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230002, Peoples R China
[5] Univ Elect Sci & Technol China, Dept Comp Sci & Engn, Chengdu 610051, Peoples R China
[6] Univ Texas San Antonio, Dept Informat Syst & Cyber Secur, San Antonio, TX 78249 USA
[7] Singapore Management Univ, Sch Informat Syst, Singapore 178902, Singapore
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Privacy; Computational modeling; Training; Federated learning; Servers; Homomorphic encryption; Convergence; heterogeneity; symmetric homomorphic encryption; privacy; lightweight computing;
D O I
10.1109/TDSC.2023.3304788
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) ensures collaborative learning among multiple clients while maintaining data locally. However, the traditional synchronous FL solutions have lower accuracy and require more communication time in scenarios where most devices drop out during learning. Therefore, we propose an Asynchronous Federated Learning (AsyFL) scheme using time-weighted and stale model aggregation, which effectively solves the problem of poor model performance due to the heterogeneity of devices. Then, we integrate Symmetric Homomorphic Encryption (SHE) into AsyFL to propose Asynchronous Privacy-Preserving Federated Learning (Asy-PPFL), which protects the privacy of clients and achieves lightweight computing. Privacy analysis shows that Asy-PPFL is indistinguishable under Known Plaintext Attack (KPA) and convergence analysis proves the effectiveness of our schemes. A large number of experiments show that AsyFL and Asy-PPFL can achieve the highest accuracy of 58.40% and 58.26% on Cifar-10 dataset when most clients (i.e., 80%) are offline or delayed, respectively.
引用
收藏
页码:2361 / 2375
页数:15
相关论文
共 50 条
  • [21] Robust Aggregation for Federated Learning by Minimum γ-Divergence Estimation
    Li, Cen-Jhih
    Huang, Pin-Han
    Ma, Yi-Ting
    Hung, Hung
    Huang, Su-Yun
    ENTROPY, 2022, 24 (05)
  • [22] Federated Learning Aggregation: New Robust Algorithms with Guarantees
    Ben Mansour, Adnan
    Carenini, Gaia
    Duplessis, Alexandre
    Naccache, David
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 721 - 726
  • [23] Robust Secure Aggregation with Lightweight Verification for Federated Learning
    Huang, Chao
    Yao, Yanqing
    Zhang, Xiaojun
    Teng, Da
    Wang, Yingdong
    Zhou, Lei
    2022 IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, 2022, : 582 - 589
  • [24] RTGA: Robust ternary gradients aggregation for federated learning
    Yang, Chengang
    Xiao, Danyang
    Cao, Bokai
    Wu, Weigang
    INFORMATION SCIENCES, 2022, 616 : 427 - 443
  • [25] Federated Machine Learning for Skin Lesion Diagnosis: An Asynchronous and Weighted Approach
    Yaqoob, Muhammad Mateen
    Alsulami, Musleh
    Khan, Muhammad Amir
    Alsadie, Deafallah
    Saudagar, Abdul Khader Jilani
    AlKhathami, Mohammed
    DIAGNOSTICS, 2023, 13 (11)
  • [26] Study of Data Imbalance and Asynchronous Aggregation Algorithm on Federated Learning System
    Diwangkara, Senapati Sang
    Kistijantoro, Achmad Imam
    2020 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY SYSTEMS AND INNOVATION (ICITSI), 2020, : 276 - 281
  • [27] Over-the-Air Federated Learning via Weighted Aggregation
    Azimi-Abarghouyi, Seyed Mohammad
    Tassiulas, Leandros
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 18240 - 18253
  • [28] Scheduling and Aggregation Design for Asynchronous Federated Learning Over Wireless Networks
    Hu, Chung-Hsuan
    Chen, Zheng
    Larsson, Erik G.
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 874 - 886
  • [29] Efficient and Secure Federated Learning With Verifiable Weighted Average Aggregation
    Yang, Zhen
    Zhou, Ming
    Yu, Haiyang
    Sinnott, Richard O.
    Liu, Huan
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (01): : 205 - 222
  • [30] Optimizing federated learning with weighted aggregation in aerial and space networks
    Dong, Fan
    Leung, Henry
    Drew, Steve
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2025, 235