Overview of Spiking Neural Network Learning Approaches and Their Computational Complexities

被引:19
|
作者
Pietrzak, Pawel [1 ]
Szczesny, Szymon [1 ]
Huderek, Damian [1 ]
Przyborowski, Lukasz [1 ]
机构
[1] Poznan Univ Tech, Inst Comp Sci, Fac Comp & Telecommun, Piotrowo 3A St, PL-61138 Poznan, Poland
关键词
spiking neural networks; learning algorithms; computational complexity; hardware;
D O I
10.3390/s23063037
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Spiking neural networks (SNNs) are subjects of a topic that is gaining more and more interest nowadays. They more closely resemble actual neural networks in the brain than their second-generation counterparts, artificial neural networks (ANNs). SNNs have the potential to be more energy efficient than ANNs on event-driven neuromorphic hardware. This can yield drastic maintenance cost reduction for neural network models, as the energy consumption would be much lower in comparison to regular deep learning models hosted in the cloud today. However, such hardware is still not yet widely available. On standard computer architectures consisting mainly of central processing units (CPUs) and graphics processing units (GPUs) ANNs, due to simpler models of neurons and simpler models of connections between neurons, have the upper hand in terms of execution speed. In general, they also win in terms of learning algorithms, as SNNs do not reach the same levels of performance as their second-generation counterparts in typical machine learning benchmark tasks, such as classification. In this paper, we review existing learning algorithms for spiking neural networks, divide them into categories by type, and assess their computational complexity.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Analysis of Spiking Dynamics and Network Morphology in a Dopamine-Reward Pavlovian Learning Spiking Neural Network
    Jeong, In Hoi
    Lee, Kyoung Jin
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S78 - S79
  • [32] Supervised Learning in Spiking Neural Networks with Synaptic Delay Plasticity: An Overview
    Lan, Yawen
    Li, Qiang
    CURRENT BIOINFORMATICS, 2020, 15 (08) : 854 - 865
  • [33] Analysis of Spiking Dynamics and Network Morphology in a Dopamine-Reward Pavlovian Learning Spiking Neural Network
    Jeong, In Hoi
    Lee, Kyoung Jin
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S78 - S79
  • [34] Synergies in coordination: a comprehensive overview of neural, computational, and behavioral approaches
    Bruton, Michaela
    O'Dwyer, Nicholas
    JOURNAL OF NEUROPHYSIOLOGY, 2018, 120 (06) : 2761 - 2774
  • [35] Effective calculations on neuromorphic hardware based on spiking neural network approaches
    Sboev A.G.
    Serenko A.V.
    Vlasov D.S.
    Lobachevskii Journal of Mathematics, 2017, 38 (5) : 964 - 966
  • [36] A High Learning Capability Probabilistic Spiking Neural Network Chip
    Hsieh, Hung-Yi
    Li, Pin-Yi
    Yang, Cheng-Han
    Tang, Kea-Tiong
    2018 INTERNATIONAL SYMPOSIUM ON VLSI DESIGN, AUTOMATION AND TEST (VLSI-DAT), 2018,
  • [37] An accurate and fast learning approach in the biologically spiking neural network
    Nazari, Soheila
    Amiri, Masoud
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [38] Unsupervised Spiking Neural Network with Dynamic Learning of Inhibitory Neurons
    Yang, Geunbo
    Lee, Wongyu
    Seo, Youjung
    Lee, Choongseop
    Seok, Woojoon
    Park, Jongkil
    Sim, Donggyu
    Park, Cheolsoo
    SENSORS, 2023, 23 (16)
  • [39] Synaptic plasticity model of a spiking neural network for reinforcement learning
    Lee, Kyoobin
    Kwon, Dong-Soo
    NEUROCOMPUTING, 2008, 71 (13-15) : 3037 - 3043
  • [40] A progressive surrogate gradient learning for memristive spiking neural network
    王姝
    陈涛
    龚钰
    孙帆
    申思远
    段书凯
    王丽丹
    Chinese Physics B, 2023, 32 (06) : 794 - 802