A BYZANTINE-RESILIENT DUAL SUBGRADIENT METHOD FOR VERTICAL FEDERATED LEARNING

被引:1
|
作者
Yuan, Kun [1 ]
Wu, Zhaoxian [2 ]
Ling, Qing [2 ]
机构
[1] Alibaba Grp, DAMO Acad, Hangzhou, Peoples R China
[2] Sun Yat Sen Univ, Guangzhou, Guangdong, Peoples R China
关键词
Vertical federated learning; Byzantine-resilience; dual subgradient method;
D O I
10.1109/ICASSP43922.2022.9747270
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Federated learning (FL) raises new challenges on security risks, especially when the FL system involves Byzantine clients that send corrupted or adversarial messages to the central server for deteriorating the training paradigm. While there is an extensive research on robust algorithms for horizontal or data-partitioned FL problems, the exploration in Byzantine-resilient vertical or feature-partitioned FL is quite limited. In this paper, we provide a problem formulation of vertical FL in the presence of Byzantine attacks, and propose a Byzantine-resilient dual subgradient method. Convergence analysis is established, and the influence of the Byzantine clients is also clarified. Numerical experiments show the proposed algorithm is robust to various Byzantine attacks on vertical FL.
引用
收藏
页码:4273 / 4277
页数:5
相关论文
共 50 条
  • [31] Byzantine-Resilient Learning Beyond Gradients: Distributing Evolutionary Search
    Kucharavy, Andrei
    Monti, Matteo
    Guerraoui, Rachid
    Dolamic, Ljiljana
    PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION, GECCO 2023 COMPANION, 2023, : 295 - 298
  • [32] Low complexity Byzantine-resilient consensus
    Miguel Correia
    Nuno Ferreira Neves
    Lau Cheuk Lung
    Paulo Veríssimo
    Distributed Computing, 2005, 17 : 237 - 249
  • [33] Dual-Domain Defenses for Byzantine-Resilient Decentralized Resource Allocation
    Wang, Runhua
    Ling, Qing
    Tian, Zhi
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2024, 10 : 804 - 819
  • [34] Low complexity Byzantine-resilient consensus
    Correia, M
    Neves, NF
    Lung, LC
    Veríssimo, P
    DISTRIBUTED COMPUTING, 2005, 17 (03) : 237 - 249
  • [35] BYZANTINE-RESILIENT DISTRIBUTED COMPUTING SYSTEMS
    PATNAIK, LM
    BALAJI, S
    SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 1987, 11 : 81 - 91
  • [36] An Efficient Byzantine-Resilient Tuple Space
    Bessani, Alysson Neves
    Correia, Miguel
    Fraga, Joni da Silva
    Lung, Lau Cheuk
    IEEE TRANSACTIONS ON COMPUTERS, 2009, 58 (08) : 1080 - 1094
  • [37] BYZANTINE-RESILIENT DECENTRALIZED RESOURCE ALLOCATION
    Wang, Runhua
    Liu, Yaohua
    Ling, Qing
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5293 - 5297
  • [38] Byzantine-Resilient Federated PCA and Low-Rank Column-Wise Sensing
    Singh, Ankit Pratap
    Vaswani, Namrata
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (11) : 8001 - 8025
  • [39] Byzantine-resilient distributed observers for LTI systems
    Mitra, Aritra
    Sundaram, Shreyas
    AUTOMATICA, 2019, 108
  • [40] BYZANTINE-RESILIENT DISTRIBUTED COMPUTING SYSTEMS.
    Patnaik, L.M.
    Balaji, S.
    Sadhana - Academy Proceedings in Engineering Sciences, 1987, 11 (1-2) : 81 - 91