Efficient Asynchronous Multi-Participant Vertical Federated Learning

被引:3
|
作者
Shi, Haoran [1 ]
Xu, Yonghui [2 ,3 ]
Jiang, Yali [1 ]
Yu, Han [4 ]
Cui, Lizhen [1 ,2 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250100, Peoples R China
[2] Shandong Univ, Joint SDU NTU Ctr Artificial Intelligence Res C FA, Jinan 250100, Peoples R China
[3] China Singapore Int Joint Res Inst, Guangzhou 510000, Peoples R China
[4] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Computational modeling; Stochastic processes; Training; Data models; Collaborative work; Privacy; Servers; Federated learning; privacy-preserving; asynchronous distributed computation;
D O I
10.1109/TBDATA.2022.3201729
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vertical Federated Learning (VFL) is a private-preserving distributed machine learning paradigm that collaboratively trains machine learning models with participants whose local data overlap largely in the sample space, but not so in the feature space. Existing VFL methods are mainly based on synchronous computation and homomorphic encryption (HE). Due to the differences in the communication and computation resources of the participants, straggling participants can cause delays during synchronous VFL model training, resulting in low computational efficiency. In addition, HE incurs high computation and communication costs. Moreover, it is difficult to establish a VFL coordinator (a.k.a. server) that all participants can trust. To address these problems, we propose an efficient Asynchronous Multi-participant Vertical Federated Learning method (AMVFL). AMVFL leverages asynchronous training which reduces waiting time. At the same time, secret sharing is used instead of HE for privacy protection, which further reduces the computational cost. In addition, AMVFL does not require a trusted entity to serve as the VFL coordinator. Experimental results based on real-world and synthetic datasets demonstrate that AMVFL can significantly reduce computational cost and improve the accuracy of the model compared to five state-of-the-art VFL methods.
引用
收藏
页码:940 / 952
页数:13
相关论文
共 50 条
  • [1] MMVFL: A Simple Vertical Federated Learning Framework for Multi-Class Multi-Participant Scenarios
    Feng, Siwei
    Yu, Han
    Zhu, Yuebing
    SENSORS, 2024, 24 (02)
  • [2] Adaptive and Efficient Participant Selection in Vertical Federated Learning
    Huang, Jiahui
    Zhang, Lan
    Li, Anran
    Cheng, Haoran
    Xu, Jiexin
    Song, Hongmei
    2023 19TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN 2023, 2023, : 455 - 462
  • [3] Efficient Participant Contribution Evaluation for Horizontal and Vertical Federated Learning
    Wang, Junhao
    Zhang, Lan
    Li, Anran
    You, Xuanke
    Cheng, Haoran
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 911 - 923
  • [4] Hierarchical Optimization for Asynchronous Vertical Federated Learning
    Li, Xinchao
    Zhang, Zhixian
    Yang, Shiyou
    Zhou, Xuhua
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2025, 15
  • [5] Interactive multi-participant tour allocation
    Funes, P
    Bonabeau, E
    Hervé, J
    Morieux, Y
    CEC2004: PROCEEDINGS OF THE 2004 CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1 AND 2, 2004, : 1699 - 1705
  • [6] Efficient Multi-Task Asynchronous Federated Learning in Edge Computing
    Cao, Xinyuan
    Ouyang, Tao
    Zhao, Kongyange
    Li, Yousheng
    Chen, Xu
    2024 IEEE/ACM 32ND INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE, IWQOS, 2024,
  • [7] Consensus measurement in multi-participant conversations
    Dirkzwager, A
    KYBERNETES, 2001, 30 (5-6) : 573 - 587
  • [8] Efficient Asynchronous Federated Learning for AUV Swarm
    Meng, Zezhao
    Li, Zhi
    Hou, Xiangwang
    Du, Jun
    Chen, Jianrui
    Wei, Wei
    SENSORS, 2022, 22 (22)
  • [9] Efficient asynchronous federated learning with sparsification and quantization
    Jia, Juncheng
    Liu, Ji
    Zhou, Chendi
    Tian, Hao
    Dong, Mianxiong
    Dou, Dejing
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (09):
  • [10] A participant selection based vehicle platoon asynchronous federated learning framework
    Ren, Yilong
    Liang, Yuhao
    Feng, Xiaoyuan
    Zhao, Yanan
    Zhao, Jiejie
    Yu, Haiyang
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2023, 34 (11)