Efficient asynchronous federated neuromorphic learning of spiking neural networks

被引:2
|
作者
Wang, Yuan [1 ]
Duan, Shukai [1 ]
Chen, Feng [1 ]
机构
[1] Southwest Univ, Coll Artificial Intelligence, Chongqing 400715, Peoples R China
关键词
Asynchronous federated learning; Spiking Neural Network; Average spike rate; Model stalenss; POWER;
D O I
10.1016/j.neucom.2023.126686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) can be trained on resource-constrained devices at low computational costs. There has been little attention to training them on a large-scale distributed system like federated learning. Federated Learning (FL) can be exploited to perform collaborative training for higher accuracy, involving multiple resource-constrained devices. In this paper, we introduce SNNs into asynchronous federated learning (AFL), which adapts to the statistical heterogeneity of users and complex communication environments. A novel fusion weight based on information age and average spike rate is designed, which aims to reduce the impact of model staleness. Numerical experiments validate SNNs on federated learning with MNIST, FashionMNIST, CIFAR10 and SVHN benchmarks, achieving better accuracy and desirable convergence under Non-IID settings.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Mapping Spiking Neural Networks onto a Manycore Neuromorphic Architecture
    Lin, Chit-Kwan
    Wild, Andreas
    Chinya, Gautham N.
    Lin, Tsung-Han
    Davies, Mike
    Wang, Hong
    PROCEEDINGS OF THE 39TH ACM SIGPLAN CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION, PLDI 2018, 2018, : 78 - 89
  • [42] Neuromorphic Speech Recognition With Photonic Convolutional Spiking Neural Networks
    Xiang, Shuiying
    Zhang, Tianrui
    Han, Yanan
    Guo, Xingxing
    Zhang, Yahui
    Shi, Yuechun
    Hao, Yue
    IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS, 2023, 29 (06)
  • [43] Spiking Neural Networks-Part III: Neuromorphic Communications
    Skatchkovsky, Nicolas
    Jang, Hyeryung
    Simeone, Osvaldo
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (06) : 1746 - 1750
  • [44] Multicore Asynchronous Simulation of Spiking Neural Networks on the Grid
    Joldos, Marius
    Muntean, Ioan Lucian
    2013 ROEDUNET INTERNATIONAL CONFERENCE (ROEDUNET): NETWORKING IN EDUCATION, 11TH EDITION, 2013,
  • [45] Compiling Spiking Neural Networks to Mitigate Neuromorphic Hardware Constraints
    Balaji, Adarsha
    Das, Anup
    2020 11TH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING WORKSHOPS (IGSC), 2020,
  • [46] A Federated Learning Protocol for Spiking Neural Membrane Systems
    Plesa, Mihail-Iulian
    Gheorghe, Marian
    Ipate, Florentin
    Zhang, Gexiang
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2024, 34 (12)
  • [47] An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks
    Zhu, Xiaolei
    Zhao, Baixin
    Ma, De
    Tang, Huajin
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (03) : 847 - 856
  • [48] Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning
    Shen, Jiangrong
    Ni, Wenyao
    Xu, Qi
    Tang, Huajin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 1, 2024, : 611 - 619
  • [49] Neural Coding in Spiking Neural Networks: A Comparative Study for Robust Neuromorphic Systems
    Guo, Wenzhe
    Fouda, Mohammed E.
    Eltawil, Ahmed M.
    Salama, Khaled Nabil
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [50] Efficient Hardware Implementation for Online Local Learning in Spiking Neural Networks
    Guo, Wenzhe
    Fouda, Mohammed E.
    Eltawil, Ahmed M.
    Salama, Khaled Nabil
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 387 - 390