Practical Federated Learning Infrastructure for Privacy-Preserving Scientific Computing

被引:0
|
作者
Wang, Lesi [1 ]
Zhao, Dongfang [1 ]
机构
[1] Univ Nevada, Dept Comp Sci & Engn, Reno, NV 89557 USA
关键词
MULTIPARTY COMPUTATION;
D O I
10.1109/AI4S56813.2022.00012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning (FL) is deemed a promising paradigm for privacy-preserving data analytics in collaborative scientific computing. However, there lacks an effective and easy-to-use FL infrastructure for scientific computing and high-performance computing (HPC) environments. The objective of this position paper is two-fold. Firstly, we identify three missing pieces of a scientific FL infrastructure: (i) a native MPI programming interface that can be seamlessly integrated into existing scientific applications, (ii) an independent data layer for the FL system such that the user can pick the persistent medium for her own choice, such as parallel file systems and multidimensional databases, and (iii) efficient encryption protocols that are optimized for scientific workflows. The second objective of this paper is to present a work-in-progress FL infrastructure, namely MPI-FL, which is implemented with PyTorch and MPI4py. We deploy MPI-FL on 1,000 CPU cores and evaluate it with four standard benchmarks: MNIST, Fashion-MNIST, CIFAR-10, and SVHN-extra. It is our hope that the scientific computing and HPC community would find MPI-FL useful for their FL-related projects.
引用
收藏
页码:38 / 43
页数:6
相关论文
共 50 条
  • [31] A Privacy-Preserving Social Computing Framework for Health Management Using Federated Learning
    Shen, Zhangyi
    Ding, Feng
    Yao, Ye
    Bhardwaj, Arpit
    Guo, Zhiwei
    Yu, Keping
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (04) : 1666 - 1678
  • [32] VPFL: A verifiable privacy-preserving federated learning scheme for edge computing systems
    Zhang, Jiale
    Liu, Yue
    Wu, Di
    Lou, Shuai
    Chen, Bing
    Yu, Shui
    DIGITAL COMMUNICATIONS AND NETWORKS, 2023, 9 (04) : 981 - 989
  • [33] Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing
    Li, Yong
    Zhou, Yipeng
    Jolfaei, Alireza
    Yu, Dongjin
    Xu, Gaochao
    Zheng, Xi
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (08) : 6178 - 6186
  • [34] PEPFL: A framework for a practical and ef fi cient privacy-preserving federated learning
    Chen, Yange
    Wang, Baocang
    Jiang, Hang
    Duan, Pu
    Ping, Yuan
    Hong, Zhiyong
    DIGITAL COMMUNICATIONS AND NETWORKS, 2024, 10 (02) : 355 - 368
  • [35] Privacy-preserving Heterogeneous Federated Transfer Learning
    Gao, Dashan
    Liu, Yang
    Huang, Anbu
    Ju, Ce
    Yu, Han
    Yang, Qiang
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2552 - 2559
  • [36] A Personalized Privacy-Preserving Scheme for Federated Learning
    Li, Zhenyu
    2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 1352 - 1356
  • [37] Privacy-preserving federated learning for radiotherapy applications
    Hayati, H.
    Heijmans, S.
    Persoon, L.
    Murguia, C.
    van de Wouw, N.
    RADIOTHERAPY AND ONCOLOGY, 2023, 182 : S238 - S240
  • [38] POSTER: Privacy-preserving Federated Active Learning
    Kurniawan, Hendra
    Mambo, Masahiro
    SCIENCE OF CYBER SECURITY, SCISEC 2022 WORKSHOPS, 2022, 1680 : 223 - 226
  • [39] AddShare: A Privacy-Preserving Approach for Federated Learning
    Asare, Bernard Atiemo
    Branco, Paula
    Kiringa, Iluju
    Yeap, Tet
    COMPUTER SECURITY. ESORICS 2023 INTERNATIONAL WORKSHOPS, PT I, 2024, 14398 : 299 - 309
  • [40] Privacy-Preserving Federated Learning for Internet of Medical Things Under Edge Computing
    Wang, Ruijin
    Lai, Jinshan
    Zhang, Zhiyang
    Li, Xiong
    Vijayakumar, Pandi
    Karuppiah, Marimuthu
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (02) : 854 - 865