Efficient asynchronous federated neuromorphic learning of spiking neural networks

被引:2
|
作者
Wang, Yuan [1 ]
Duan, Shukai [1 ]
Chen, Feng [1 ]
机构
[1] Southwest Univ, Coll Artificial Intelligence, Chongqing 400715, Peoples R China
关键词
Asynchronous federated learning; Spiking Neural Network; Average spike rate; Model stalenss; POWER;
D O I
10.1016/j.neucom.2023.126686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) can be trained on resource-constrained devices at low computational costs. There has been little attention to training them on a large-scale distributed system like federated learning. Federated Learning (FL) can be exploited to perform collaborative training for higher accuracy, involving multiple resource-constrained devices. In this paper, we introduce SNNs into asynchronous federated learning (AFL), which adapts to the statistical heterogeneity of users and complex communication environments. A novel fusion weight based on information age and average spike rate is designed, which aims to reduce the impact of model staleness. Numerical experiments validate SNNs on federated learning with MNIST, FashionMNIST, CIFAR10 and SVHN benchmarks, achieving better accuracy and desirable convergence under Non-IID settings.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] A burst-dependent algorithm for neuromorphic on-chip learning of spiking neural networks
    Stuck, Michael
    Wang, Xingyun
    Naud, Richard
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2025, 5 (01):
  • [32] Efficient and Robust Supervised Learning Algorithm for Spiking Neural Networks
    Zhang Y.
    Geng T.
    Zhang M.
    Wu X.
    Zhou J.
    Qu H.
    Sensing and Imaging, 2018, 19 (1):
  • [33] Photonic Spiking Neural Networks with Highly Efficient Training Protocols for Ultrafast Neuromorphic Computing Systems
    Owen-Newns, Dafydd
    Robertson, Joshua
    Hejda, Matěj
    Hurtado, Antonio
    Intelligent Computing, 2023, 2
  • [34] Communication-Efficient Federated Learning With Binary Neural Networks
    Yang, Yuzhi
    Zhang, Zhaoyang
    Yang, Qianqian
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3836 - 3850
  • [35] Efficient Asynchronous Federated Learning for AUV Swarm
    Meng, Zezhao
    Li, Zhi
    Hou, Xiangwang
    Du, Jun
    Chen, Jianrui
    Wei, Wei
    SENSORS, 2022, 22 (22)
  • [36] Efficient asynchronous federated learning with sparsification and quantization
    Jia, Juncheng
    Liu, Ji
    Zhou, Chendi
    Tian, Hao
    Dong, Mianxiong
    Dou, Dejing
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (09):
  • [37] Versatile emulation of spiking neural networks on an accelerated neuromorphic substrate
    Billaudelle, S.
    Stradmann, Y.
    Schreiber, K.
    Cramer, B.
    Baumbach, A.
    Dold, D.
    Goeltz, J.
    Kungl, A. F.
    Wunderlich, T. C.
    Hartel, A.
    Mueller, E.
    Breitwieser, O.
    Mauch, C.
    Kleider, M.
    Gruebl, A.
    Stoeckel, D.
    Pehle, C.
    Heimbrecht, A.
    Spilger, P.
    Kiene, G.
    Karasenko, V
    Senn, W.
    Petrovici, M. A.
    Schemmel, J.
    Meier, K.
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [38] Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
    Sorbaro, Martino
    Liu, Qian
    Bortone, Massimo
    Sheik, Sadique
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [39] Mapping Spiking Neural Networks onto a Manycore Neuromorphic Architecture
    Lin, Chit-Kwan
    Wild, Andreas
    Chinya, Gautham N.
    Lin, Tsung-Han
    Davies, Mike
    Wang, Hong
    ACM SIGPLAN NOTICES, 2018, 53 (04) : 78 - 89
  • [40] Heartbeat Classification with Spiking Neural Networks on the Loihi Neuromorphic Processor
    Buettner, Kyle
    George, Alan D.
    2021 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2021), 2021, : 138 - 143