Efficient asynchronous federated neuromorphic learning of spiking neural networks

被引:2
|
作者
Wang, Yuan [1 ]
Duan, Shukai [1 ]
Chen, Feng [1 ]
机构
[1] Southwest Univ, Coll Artificial Intelligence, Chongqing 400715, Peoples R China
关键词
Asynchronous federated learning; Spiking Neural Network; Average spike rate; Model stalenss; POWER;
D O I
10.1016/j.neucom.2023.126686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) can be trained on resource-constrained devices at low computational costs. There has been little attention to training them on a large-scale distributed system like federated learning. Federated Learning (FL) can be exploited to perform collaborative training for higher accuracy, involving multiple resource-constrained devices. In this paper, we introduce SNNs into asynchronous federated learning (AFL), which adapts to the statistical heterogeneity of users and complex communication environments. A novel fusion weight based on information age and average spike rate is designed, which aims to reduce the impact of model staleness. Numerical experiments validate SNNs on federated learning with MNIST, FashionMNIST, CIFAR10 and SVHN benchmarks, achieving better accuracy and desirable convergence under Non-IID settings.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Federated Learning With Spiking Neural Networks
    Venkatesha, Yeshwanth
    Kim, Youngeun
    Tassiulas, Leandros
    Panda, Priyadarshini
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 6183 - 6194
  • [2] FEDERATED NEUROMORPHIC LEARNING OF SPIKING NEURAL NETWORKS FOR LOW-POWER EDGE INTELLIGENCE
    Skatchkovsky, Nicolas
    Fang, Hyeryung
    Simeone, Osvaldo
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8524 - 8528
  • [3] HFedSNN: Efficient Hierarchical Federated Learning using Spiking Neural Networks
    Aouedi, Ons
    Piamrat, Kandaraj
    Sudholt, Mario
    PROCEEDINGS OF THE INT'L ACM SYMPOSIUM ON MOBILITY MANAGEMENT AND WIRELESS ACCESS, MOBIWAC 2023, 2023, : 53 - 60
  • [5] Federated Learning with Spiking Neural Networks in Heterogeneous Systems
    Tumpa, Sadia Anjum
    Singh, Sonali
    Khan, Md Fahim Faysal
    Kandemir, Mahmut Tylan
    Narayanan, Vijaykrishnan
    Das, Chita R.
    2023 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI, ISVLSI, 2023, : 49 - 54
  • [6] Efficient Deployment of Spiking Neural Networks on SpiNNaker Neuromorphic Platform
    Galanis, Ioannis
    Anagnostopoulos, Iraklis
    Nguyen, Chinh
    Bares, Guillermo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2021, 68 (06) : 1937 - 1941
  • [7] Efficient learning in spiking neural networks
    Rast, Alexander
    Aoun, Mario Antoine
    Elia, Eleni G.
    Crook, Nigel
    NEUROCOMPUTING, 2024, 597
  • [8] Neuromorphic implementations of neurobiological learning algorithms for spiking neural networks
    Walter, Florian
    Roehrbein, Florian
    Knoll, Alois
    NEURAL NETWORKS, 2015, 72 : 152 - 167
  • [9] NeuroMoCo: a neuromorphic momentum contrast learning method for spiking neural networks
    Ma, Yuqi
    Wang, Huamin
    Shen, Hangchi
    Chen, Xuemei
    Duan, Shukai
    Wen, Shiping
    APPLIED INTELLIGENCE, 2025, 55 (02)
  • [10] In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor
    Shrestha, Amar
    Fang, Haowen
    Rider, Daniel Patrick
    Mei, Zaidao
    Qiu, Qinru
    2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, : 367 - 372