Contribution-wise Byzantine-robust aggregation for Class-Balanced Federated Learning

被引:0
|
作者
Li, Yanli [1 ]
Ding, Weiping [3 ]
Chen, Huaming [1 ]
Bao, Wei [2 ]
Yuan, Dong [1 ]
机构
[1] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW 2006, Australia
[2] Univ Sydney, Sch Comp Sci, Sydney, NSW 2006, Australia
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
关键词
Federated learning (FL); Poisoning attack; Byzantine-robust aggregation; Adversarial machine learning; Non-independent identical (non-IID);
D O I
10.1016/j.ins.2024.120475
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a promising approach that allows many clients to jointly train a model without sharing the raw data. Due to the clients' different preferences, the class imbalance issue frequently occurs in real -world FL problems and poses threats for poisoning attacks to the existing FL methods. In this work, we first propose a new attack called Class Imbalance Attack that can degrade the testing accuracy of a particular class(es) to even 0 under the state-of-the-art robust FL methods. To defend against such attacks, we further propose a Class -Balanced FL method with a novel contribution -wise Byzantine -robust aggregation rule. In the designed rule, an honest score and a contribution score will be assigned to each client dynamically according to the server model. The server itself will be initiated with a small dataset, and a model (called server model) will be maintained. These two scores will be subsequently used to calculate the weighted average of the client gradients for each training iteration. The experiments are conducted on five datasets against state-of-the-art poisoning attacks, including the Class Imbalance Attack. The empirical results demonstrate the effectiveness of the proposed Class -Balanced FL method.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] FedInv: Byzantine-Robust Federated Learning by Inversing Local Model Updates
    Zhao, Bo
    Sun, Peng
    Wang, Tao
    Jiang, Keyu
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 9171 - 9179
  • [42] BFLMeta: Blockchain-Empowered Metaverse with Byzantine-Robust Federated Learning
    Vu Tuan Truong
    Hoang, Duc N. M.
    Long Bao Le
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5537 - 5542
  • [43] Using Third-Party Auditor to Help Federated Learning: An Efficient Byzantine-Robust Federated Learning
    Zhang, Zhuangzhuang
    Wu, Libing
    He, Debiao
    Li, Jianxin
    Lu, Na
    Wei, Xuejiang
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2024, 9 (06): : 848 - 861
  • [44] PEAR: privacy-preserving and effective aggregation for byzantine-robust federated learning in real-world scenarios
    Sun, Han
    Zhang, Yan
    Zhuang, Huiping
    Li, Jiatong
    Xu, Zhen
    Wu, Liji
    COMPUTER JOURNAL, 2025,
  • [45] Defense against local model poisoning attacks to byzantine-robust federated learning
    Shiwei Lu
    Ruihu Li
    Xuan Chen
    Yuena Ma
    Frontiers of Computer Science, 2022, 16
  • [46] RSAM: Byzantine-Robust and Secure Model Aggregation in Federated Learning for Internet of Vehicles Using Private Approximate Median
    He, Yuanyuan
    Li, Peizhi
    Ni, Jianbing
    Deng, Xianjun
    Lu, Hongwei
    Zhang, Jie
    Yang, Laurence T.
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 6714 - 6726
  • [47] Byzantine-Robust Decentralized Learning via Remove-then-Clip Aggregation
    Yang, Caiyi
    Ghaderi, Javad
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 19, 2024, : 21735 - 21743
  • [48] Efficient Byzantine-Robust and Privacy-Preserving Federated Learning on Compressive Domain
    Hu, Guiqiang
    Li, Hongwei
    Fan, Wenshu
    Zhang, Yushu
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (04): : 7116 - 7127
  • [49] Byzantine-Robust Federated Learning via Server-Side Mixtue of Experts
    Li, Jing (lj@ustc.edu.cn), 1600, Springer Science and Business Media Deutschland GmbH (14326 LNAI):
  • [50] Privacy-Preserving Byzantine-Robust Federated Learning via Blockchain Systems
    Miao, Yinbin
    Liu, Ziteng
    Li, Hongwei
    Choo, Kim-Kwang Raymond
    Deng, Robert H.
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 2848 - 2861