Privacy-Preserving and Decentralized Federated Learning Model Based on the Blockchain

被引:0
|
作者
Zhou W. [1 ,2 ]
Wang C. [1 ]
Xu J. [3 ]
Hu K. [1 ]
Wang J. [1 ]
机构
[1] School of Information and Control Engineering, Qingdao University of Technology, Qingdao
[2] National Key Laboratory of Mass Customization System and Technology (Haier Group Corporation), Qingdao
[3] Software College, Northeastern University, Shenyang
基金
中国国家自然科学基金;
关键词
Bilinear-map accumulator; Blockchain; Federated learning; Homomorphic encryption; Privacy-preserving; Reputation;
D O I
10.7544/issn1000-1239.20220470
中图分类号
学科分类号
摘要
Traditional federated learning relies on a central server, and the training process is vulnerable to single point of failure and malicious attacks from nodes, and intermediate parameters passed in plaintext may be exploited to infer the private information in data. A decentralized, secure, and fair federated learning model based on the blockchain is proposed, using homomorphic encryption technology to protect the privacy of the intermediate parameters of the collaborative training parties. Model aggregation and collaborative decryption are carried out through the elected federated learning committee. The decryption process achieves secure key management through a secret sharing scheme, using bilinear-map accumulator to provide verification of correctness for the secret share. The model also introduces reputation as an indicator to evaluate the reliability of the participants, and uses the subjective logic model to realize disbelief enhanced reputation calculation as the basis for the election of the federated learning committee. The reputation value can be used as a reference for the incentive mechanism to ensure fairness. Model information and the reputation value realize data tamper-proof and non-repudiation through the blockchain. Experiments show that in the condition of the training, accuracy is slightly lower than that of the centralized learning model, and model can guarantee that it can be trained in a decentralized manner in multi-party collaborative environment, and implement data privacy protection for all participants. © 2022, Science Press. All right reserved.
引用
收藏
页码:2423 / 2436
页数:13
相关论文
共 40 条
  • [1] Hinton G, Deng Li, Yu Dong, Et al., Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, IEEE Signal Processing Magazine, 29, 6, pp. 82-97, (2012)
  • [2] Chan Tsunghan, Jia Kui, Gao Shenghua, Et al., PCANet: A simple deep learning baseline for image classification?, IEEE Transactions on Image Processing, 24, 12, pp. 5017-5032, (2015)
  • [3] Gawehn E, Hiss J A, Schneider G., Deep learning in drug discovery, Molecular Informatics, 35, 1, pp. 3-14, (2016)
  • [4] Lampos V, Miller A C, Crossan S, Et al., Advances in nowcasting influenza-like illness rates using search query logs, Scientific Reports, 5, 1, pp. 1-10, (2015)
  • [5] Ness R B, Influence of the HIPAA privacy rule on health research, The Journal of the American Medical Association, 298, 18, pp. 2164-2170, (2007)
  • [6] Goddard M., The EU general data protection regulation (GDPR): European regulation that has a global impact, International Journal of Market Research, 59, 6, pp. 703-705, (2017)
  • [7] Konecny J, Mcmahan H B, Ramage D, Et al., Federated optimization: Distributed machine learning for on-device intelligence, (2016)
  • [8] Bonawitz K, Ivanov V, Kreuter B, Et al., Practical secure aggregation for privacy-preserving machine learning, Proc of the 2017 ACM SIGSAC Conf on Computer and Communications Security, pp. 1175-1191, (2017)
  • [9] McMahan H B, Moore E, Ramage D, Et al., Federated learning of deep networks using model averaging, (2016)
  • [10] Liu Yixuan, Chen Hong, Liu Yuhan, Et al., Privacy-preserving strategies in federated learning, Journal of Software, 33, 3, pp. 1057-1092, (2022)