Efficient Asynchronous Multi-Participant Vertical Federated Learning

被引:3
|
作者
Shi, Haoran [1 ]
Xu, Yonghui [2 ,3 ]
Jiang, Yali [1 ]
Yu, Han [4 ]
Cui, Lizhen [1 ,2 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250100, Peoples R China
[2] Shandong Univ, Joint SDU NTU Ctr Artificial Intelligence Res C FA, Jinan 250100, Peoples R China
[3] China Singapore Int Joint Res Inst, Guangzhou 510000, Peoples R China
[4] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Computational modeling; Stochastic processes; Training; Data models; Collaborative work; Privacy; Servers; Federated learning; privacy-preserving; asynchronous distributed computation;
D O I
10.1109/TBDATA.2022.3201729
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vertical Federated Learning (VFL) is a private-preserving distributed machine learning paradigm that collaboratively trains machine learning models with participants whose local data overlap largely in the sample space, but not so in the feature space. Existing VFL methods are mainly based on synchronous computation and homomorphic encryption (HE). Due to the differences in the communication and computation resources of the participants, straggling participants can cause delays during synchronous VFL model training, resulting in low computational efficiency. In addition, HE incurs high computation and communication costs. Moreover, it is difficult to establish a VFL coordinator (a.k.a. server) that all participants can trust. To address these problems, we propose an efficient Asynchronous Multi-participant Vertical Federated Learning method (AMVFL). AMVFL leverages asynchronous training which reduces waiting time. At the same time, secret sharing is used instead of HE for privacy protection, which further reduces the computational cost. In addition, AMVFL does not require a trusted entity to serve as the VFL coordinator. Experimental results based on real-world and synthetic datasets demonstrate that AMVFL can significantly reduce computational cost and improve the accuracy of the model compared to five state-of-the-art VFL methods.
引用
收藏
页码:940 / 952
页数:13
相关论文
共 50 条
  • [31] Unsupervised classification of speaker roles in multi-participant conversational speech
    Li, Yanxiong
    Wang, Qin
    Zhang, Xue
    Li, Wei
    Li, Xinchao
    Yang, Jichen
    Feng, Xiaohui
    Huang, Qian
    He, Qianhua
    COMPUTER SPEECH AND LANGUAGE, 2017, 42 : 81 - 99
  • [32] Participant and Sample Selection for Efficient Online Federated Learning in UAV Swarms
    Wu, Feiyu
    Qu, Yuben
    Wu, Tao
    Dong, Chao
    Guo, Kefeng
    Wu, Qihui
    Guo, Song
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (12): : 21202 - 21214
  • [33] Privacy-Preserving Asynchronous Vertical Federated Learning Algorithms for Multiparty Collaborative Learning
    Gu, Bin
    Xu, An
    Huo, Zhouyuan
    Deng, Cheng
    Huang, Heng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6103 - 6115
  • [34] Effect of Multiple Auditory Localization for Multi-Participant Remote Conversation
    Ye, Jing
    Noguchi, Yasuhito
    Inoue, Tomoo
    PROCEEDINGS OF THE 2015 IEEE 19TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2015, : 247 - 252
  • [35] Risk Analysis of Multi-participant Service Innovation's Platform
    Liu Dewen
    Lu Ruoyu
    ADVANCES IN MANAGEMENT OF TECHNOLOGY, PT 2, 2008, : 706 - +
  • [36] A Framework for Multi-participant Narratives Based on Multiplayer Game Interactions
    Spawforth, Callum
    Millard, David E.
    INTERACTIVE STORYTELLING, ICIDS 2017, 2017, 10690 : 150 - 162
  • [37] The Interactive Dance Club: Avoiding chaos in a multi-participant environment
    Ulyate, R
    Bianciardi, D
    COMPUTER MUSIC JOURNAL, 2002, 26 (03) : 40 - 49
  • [38] Management Coordination for Multi-Participant Supply Chains Under Uncertainty
    Hjaila, Kefah
    Lainez-Aguirre, Jose M.
    Puigjaner, Luis
    Espuna, Antonio
    OPERATIONS RESEARCH PROCEEDINGS 2015, 2017, : 437 - 443
  • [39] EFMVFL: An Efficient and Flexible Multi-party Vertical Federated Learning without a Third Party
    Huang, Yimin
    Wang, Wanwan
    Zhao, Xingying
    Wang, Yukun
    Feng, Xinyu
    He, Hao
    Yao, Ming
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (03)
  • [40] Secure and fast asynchronous Vertical Federated Learning via cascaded hybrid optimization
    Wang, Ganyu
    Zhang, Qingsong
    Li, Xiang
    Wang, Boyu
    Gu, Bin
    Ling, Charles X.
    MACHINE LEARNING, 2024, 113 (09) : 6413 - 6451