Overview of Spiking Neural Network Learning Approaches and Their Computational Complexities

被引:19
|
作者
Pietrzak, Pawel [1 ]
Szczesny, Szymon [1 ]
Huderek, Damian [1 ]
Przyborowski, Lukasz [1 ]
机构
[1] Poznan Univ Tech, Inst Comp Sci, Fac Comp & Telecommun, Piotrowo 3A St, PL-61138 Poznan, Poland
关键词
spiking neural networks; learning algorithms; computational complexity; hardware;
D O I
10.3390/s23063037
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Spiking neural networks (SNNs) are subjects of a topic that is gaining more and more interest nowadays. They more closely resemble actual neural networks in the brain than their second-generation counterparts, artificial neural networks (ANNs). SNNs have the potential to be more energy efficient than ANNs on event-driven neuromorphic hardware. This can yield drastic maintenance cost reduction for neural network models, as the energy consumption would be much lower in comparison to regular deep learning models hosted in the cloud today. However, such hardware is still not yet widely available. On standard computer architectures consisting mainly of central processing units (CPUs) and graphics processing units (GPUs) ANNs, due to simpler models of neurons and simpler models of connections between neurons, have the upper hand in terms of execution speed. In general, they also win in terms of learning algorithms, as SNNs do not reach the same levels of performance as their second-generation counterparts in typical machine learning benchmark tasks, such as classification. In this paper, we review existing learning algorithms for spiking neural networks, divide them into categories by type, and assess their computational complexity.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Spiking Neural Networks for Computational Intelligence: An Overview
    Dora, Shirin
    Kasabov, Nikola
    BIG DATA AND COGNITIVE COMPUTING, 2021, 5 (04)
  • [2] Spiking neural network approaches PCA with metaheuristics
    Enriquez-Gaytan, J.
    Gomez-Castaneda, F.
    Flores-Nava, L. M.
    Moreno-Cadenas, J. A.
    ELECTRONICS LETTERS, 2020, 56 (10) : 488 - +
  • [3] Supervised learning in a spiking neural network
    Myoung Won Cho
    Journal of the Korean Physical Society, 2021, 79 : 328 - 335
  • [4] Supervised learning in a spiking neural network
    Cho, Myoung Won
    JOURNAL OF THE KOREAN PHYSICAL SOCIETY, 2021, 79 (03) : 328 - 335
  • [5] Computational modeling of spiking neural network with learning rules from STDP and intrinsic plasticity
    Li, Xiumin
    Wang, Wei
    Xue, Fangzheng
    Song, Yongduan
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2018, 491 : 716 - 728
  • [6] Spiking Neural Networks and online learning: An overview and perspectives
    Lobo, Jesus L.
    Del Ser, Javier
    Bifet, Albert
    Kasabov, Nikola
    NEURAL NETWORKS, 2020, 121 : 88 - 100
  • [7] Learning-based Approaches for Controlling Neural Spiking
    Liu, Sensen
    Sock, Noah M.
    Ching, ShiNung
    2018 ANNUAL AMERICAN CONTROL CONFERENCE (ACC), 2018, : 2827 - 2832
  • [8] RESEARCH ON LEARNING ALGORITHM OF SPIKING NEURAL NETWORK
    Li, Shun-Li
    Li, Jian-Ping
    2019 16TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICWAMTIP), 2019, : 45 - 48
  • [9] StereoSpike: Depth Learning With a Spiking Neural Network
    Rancon, Ulysse
    Cuadrado-Anibarro, Javier
    Cottereau, Benoit R.
    Masquelier, Timothee
    IEEE ACCESS, 2022, 10 : 127428 - 127439
  • [10] A Spiking Neural Network Learning Markov Chain
    Kiselev, Mikhail
    Ivanitsky, Alexander
    Lavrentyev, Andrey
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,