Practical Federated Learning Infrastructure for Privacy-Preserving Scientific Computing

被引:0
|
作者
Wang, Lesi [1 ]
Zhao, Dongfang [1 ]
机构
[1] Univ Nevada, Dept Comp Sci & Engn, Reno, NV 89557 USA
关键词
MULTIPARTY COMPUTATION;
D O I
10.1109/AI4S56813.2022.00012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning (FL) is deemed a promising paradigm for privacy-preserving data analytics in collaborative scientific computing. However, there lacks an effective and easy-to-use FL infrastructure for scientific computing and high-performance computing (HPC) environments. The objective of this position paper is two-fold. Firstly, we identify three missing pieces of a scientific FL infrastructure: (i) a native MPI programming interface that can be seamlessly integrated into existing scientific applications, (ii) an independent data layer for the FL system such that the user can pick the persistent medium for her own choice, such as parallel file systems and multidimensional databases, and (iii) efficient encryption protocols that are optimized for scientific workflows. The second objective of this paper is to present a work-in-progress FL infrastructure, namely MPI-FL, which is implemented with PyTorch and MPI4py. We deploy MPI-FL on 1,000 CPU cores and evaluate it with four standard benchmarks: MNIST, Fashion-MNIST, CIFAR-10, and SVHN-extra. It is our hope that the scientific computing and HPC community would find MPI-FL useful for their FL-related projects.
引用
收藏
页码:38 / 43
页数:6
相关论文
共 50 条
  • [21] CryptoFE: Practical and Privacy-Preserving Federated Learning via Functional Encryption
    Qian, Xinyuan
    Li, Hongwei
    Hao, Meng
    Yuan, Shuai
    Zhang, Xilin
    Guo, Song
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2999 - 3004
  • [22] Privacy-Preserving and Low-Latency Federated Learning in Edge Computing
    He, Chunrong
    Liu, Guiyan
    Guo, Songtao
    Yang, Yuanyuan
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (20): : 20149 - 20159
  • [23] An Efficient and Dynamic Privacy-Preserving Federated Learning System for Edge Computing
    Tang, Xinyu
    Guo, Cheng
    Choo, Kim-Kwang Raymond
    Liu, Yining
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 207 - 220
  • [24] A privacy-preserving federated learning scheme with homomorphic encryption and edge computing
    Zhu, Bian
    Niu, Ling
    ALEXANDRIA ENGINEERING JOURNAL, 2025, 118 : 11 - 20
  • [25] Towards Privacy-Preserving Federated Deep Learning infrastructure : proof-of-concept
    Zhang, C.
    Choudhury, A.
    Bermejo, I.
    Dekker, A.
    RADIOTHERAPY AND ONCOLOGY, 2022, 170 : S949 - S950
  • [26] The Blockchain-Based Edge Computing Framework for Privacy-Preserving Federated Learning
    Hu, Shili
    Li, Jiangfeng
    Zhang, Chenxi
    Zhao, Qinpei
    Ye, Wei
    2021 IEEE INTERNATIONAL CONFERENCE ON BLOCKCHAIN (BLOCKCHAIN 2021), 2021, : 566 - 571
  • [27] Privacy-Preserving and Reliable Decentralized Federated Learning
    Gao, Yuanyuan
    Zhang, Lei
    Wang, Lulu
    Choo, Kim-Kwang Raymond
    Zhang, Rui
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (04) : 2879 - 2891
  • [28] Privacy-preserving federated learning on lattice quantization
    Zhang, Lingjie
    Zhang, Hai
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2023, 21 (06)
  • [29] Privacy-Preserving Federated Deep Learning for Cooperative Hierarchical Caching in Fog Computing
    Yu, Zhengxin
    Hu, Jia
    Min, Geyong
    Wang, Zi
    Miao, Wang
    Li, Shancang
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22): : 22246 - 22255
  • [30] Ubiquitous intelligent federated learning privacy-preserving scheme under edge computing
    Li, Dongfen
    Lai, Jinshan
    Wang, Ruijin
    Li, Xiong
    Vijayakumar, Pandi
    Alhalabi, Wadee
    Gupta, Brij B.
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 144 : 205 - 218