Overview of Spiking Neural Network Learning Approaches and Their Computational Complexities

被引:19
|
作者
Pietrzak, Pawel [1 ]
Szczesny, Szymon [1 ]
Huderek, Damian [1 ]
Przyborowski, Lukasz [1 ]
机构
[1] Poznan Univ Tech, Inst Comp Sci, Fac Comp & Telecommun, Piotrowo 3A St, PL-61138 Poznan, Poland
关键词
spiking neural networks; learning algorithms; computational complexity; hardware;
D O I
10.3390/s23063037
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Spiking neural networks (SNNs) are subjects of a topic that is gaining more and more interest nowadays. They more closely resemble actual neural networks in the brain than their second-generation counterparts, artificial neural networks (ANNs). SNNs have the potential to be more energy efficient than ANNs on event-driven neuromorphic hardware. This can yield drastic maintenance cost reduction for neural network models, as the energy consumption would be much lower in comparison to regular deep learning models hosted in the cloud today. However, such hardware is still not yet widely available. On standard computer architectures consisting mainly of central processing units (CPUs) and graphics processing units (GPUs) ANNs, due to simpler models of neurons and simpler models of connections between neurons, have the upper hand in terms of execution speed. In general, they also win in terms of learning algorithms, as SNNs do not reach the same levels of performance as their second-generation counterparts in typical machine learning benchmark tasks, such as classification. In this paper, we review existing learning algorithms for spiking neural networks, divide them into categories by type, and assess their computational complexity.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] A Heterogeneous Spiking Neural Network for Unsupervised Learning of Spatiotemporal Patterns
    She, Xueyuan
    Dash, Saurabh
    Kim, Daehyun
    Mukhopadhyay, Saibal
    FRONTIERS IN NEUROSCIENCE, 2021, 14
  • [42] Relative ordering learning in spiking neural network for pattern recognition
    Lin, Zhitao
    Ma, De
    Meng, Jianyi
    Chen, Linna
    NEUROCOMPUTING, 2018, 275 : 94 - 106
  • [43] An Analog Probabilistic Spiking Neural Network with On-Chip Learning
    Hsieh, Hung-Yi
    Li, Pin-Yi
    Tang, Kea-Tiong
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT VI, 2017, 10639 : 777 - 785
  • [44] Performance evaluation of a temporal sequence learning spiking neural network
    Ichishita, T.
    Fujii, R. H.
    2007 CIT: 7TH IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY, PROCEEDINGS, 2007, : 616 - 620
  • [45] A progressive surrogate gradient learning for memristive spiking neural network
    Wang, Shu
    Chen, Tao
    Gong, Yu
    Sun, Fan
    Shen, Si-Yuan
    Duan, Shu-Kai
    Wang, Li-Dan
    CHINESE PHYSICS B, 2023, 32 (06)
  • [46] Editorial: Spiking Neural Network Learning, Benchmarking, Programming and Executing
    Li, Guoqi
    Deng, Lei
    Chua, Yansong
    Li, Peng
    Neftci, Emre O.
    Li, Haizhou
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [47] A novel spiking neural network with the learning strategy of biomimetic structure
    Lv, Mengyu
    Shao, Cuiping
    Li, Huiyun
    Li, Jun
    Sun, Tianfu
    2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021), 2021, : 69 - 74
  • [48] Local unsupervised learning rules for a spiking neural network with dendrite
    Olivier FL Manette
    BMC Neuroscience, 12 (Suppl 1)
  • [49] Hierarchical Fusion Evolving Spiking Neural Network for Adaptive Learning
    Al Zoubi, Obada
    Mayeli, Ahmad
    Awad, Mariette
    Retai, Hazem
    PROCEEDINGS OF 2018 IEEE 17TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI*CC 2018), 2018, : 86 - 91
  • [50] Spiking-HDC: A Spiking Neural Network Processor with HDC Classifier Enabling Transfer Learning
    Xiao, Anqin
    Zheng, Xin
    Yang, Finqiao
    Zheng, Lirong
    Zou, Zhuo
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,