VERSA: Verifiable Secure Aggregation for Cross-Device Federated Learning

被引:33
|
作者
Hahn, Changhee [1 ]
Kim, Hodong [2 ]
Kim, Minjae [2 ]
Hur, Junbeom [2 ]
机构
[1] Seoul Natl Univ Sci & Technol, Dept Elect & Informat Engn, Seoul 01811, South Korea
[2] Korea Univ, Dept Comp Sci & Engn, Seoul 02841, South Korea
基金
新加坡国家研究基金会;
关键词
Computational modeling; Servers; Data models; Training; Cryptography; Codes; Data privacy; Federated learning; distributed machine learning; security; privacy; MULTIPARTY COMPUTATION; DEEP; INFERENCE; SYSTEM;
D O I
10.1109/TDSC.2021.3126323
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In privacy-preserving cross-device federated learning, users train a global model on their local data and submit encrypted local models, while an untrusted central server aggregates the encrypted models to obtain an updated global model. Prior work has demonstrated how to verify the correctness of aggregation in such a setting. However, such verification relies on strong assumptions, such as a trusted setup among all users under unreliable network conditions, or it suffers from expensive cryptographic operations, such as bilinear pairing. In this paper, we scrutinize the verification mechanism of prior work and propose a model recovery attack, demonstrating that most local models can be leaked within a reasonable time (e.g., 98% of encrypted local models are recovered within 21 h). Then, we propose VERSA, a verifiable secure aggregation protocol for cross-device federated learning. VERSA does not require any trusted setup for verification between users while minimizing the verification cost by enabling both the central server and users to utilize only a lightweight pseudorandom generator to prove and verify the correctness of model aggregation. We experimentally confirm the efficiency of VERSA under diverse datasets, demonstrating that VERSA is orders of magnitude faster than verification in prior work.
引用
收藏
页码:36 / 52
页数:17
相关论文
共 50 条
  • [11] Breaking the centralized barrier for cross-device federated learning
    Karimireddy, Sai Praneeth
    Jaggi, Martin
    Kale, Satyen
    Mohri, Mehryar
    Reddi, Sashank J.
    Stich, Sebastian U.
    Suresh, Ananda Theertha
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [12] Client Selection Algorithm in Cross-device Federated Learning
    Zhang, Rui-Lin
    Du, Jin-Hua
    Yin, Hao
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (12): : 5725 - 5740
  • [13] VSAFL: Verifiable and Secure Aggregation With (Poly) Logarithmic Overhead in Federated Learning
    He, Yanlin
    Zhou, Dehua
    Zhang, Qiaohong
    Tan, Ziqi
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (23): : 38552 - 38568
  • [14] Scaling Language Model Size in Cross-Device Federated Learning
    Ro, Jae Hun
    Breiner, Theresa
    McConnaughey, Lara
    Chen, Mingqing
    Suresh, Ananda Theertha
    Kumar, Shankar
    Mathews, Rajiv
    PROCEEDINGS OF THE FIRST WORKSHOP ON FEDERATED LEARNING FOR NATURAL LANGUAGE PROCESSING (FL4NLP 2022), 2022, : 6 - 20
  • [15] Device Scheduling for Secure Aggregation in Wireless Federated Learning
    Yan, Na
    Wang, Kezhi
    Zhi, Kangda
    Pan, Cunhua
    Poor, H. Vincent
    Chai, Kok Keong
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28851 - 28862
  • [16] VerifyNet: Secure and Verifiable Federated Learning
    Xu, Guowen
    Li, Hongwei
    Liu, Sen
    Yang, Kan
    Lin, Xiaodong
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 : 911 - 926
  • [17] VOSA: Verifiable and Oblivious Secure Aggregation for Privacy-Preserving Federated Learning
    Wang, Yong
    Zhang, Aiqing
    Wu, Shu
    Yu, Shui
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2023, 20 (05) : 3601 - 3616
  • [18] SVCA: Secure and Verifiable Chained Aggregation for Privacy-Preserving Federated Learning
    Xia, Yuanjun
    Liu, Yining
    Dong, Shi
    Li, Meng
    Guo, Cheng
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 18351 - 18365
  • [19] On the Security of Verifiable and Oblivious Secure Aggregation for Privacy-Preserving Federated Learning
    Wu, Jiahui
    Zhang, Weizhe
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2024, 21 (05) : 4324 - 4326
  • [20] An effective and verifiable secure aggregation scheme with privacy-preserving for federated learning
    Wang, Rong
    Xiong, Ling
    Geng, Jiazhou
    Xie, Chun
    Li, Ruidong
    JOURNAL OF SYSTEMS ARCHITECTURE, 2025, 161