DSNNs: learning transfer from deep neural networks to spiking neural networks

被引:0
|
作者
Zhang L. [1 ,2 ,3 ]
Du Z. [1 ,2 ,3 ]
Li L. [4 ]
Chen Y. [1 ,2 ]
机构
[1] State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[2] Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[3] Cambricon Tech. Ltd, Beijing
[4] Institute of Software, Chinese Academy of Sciences, Beijing
来源
High Technology Letters | 2020年 / 26卷 / 02期
基金
中国国家自然科学基金;
关键词
Convert method; Deep leaning; Spatially folded network; Spiking neural network (SNN);
D O I
10.3772/j.issn.1006-6748.2020.02.002
中图分类号
学科分类号
摘要
Deep neural networks (DNNs) have drawn great attention as they perform the state-of-the-art results on many tasks. Compared to DNNs, spiking neural networks (SNNs), which are considered as the new generation of neural networks, fail to achieve comparable performance especially on tasks with large problem sizes. Many previous work tried to close the gap between DNNs and SNNs but used small networks on simple tasks. This work proposes a simple but effective way to construct deep spiking neural networks (DSNNs) by transferring the learned ability of DNNs to SNNs. DSNNs achieve comparable accuracy on large networks and complex datasets. Copyright © by HIGH TECHNOLOGY LETTERS PRESS.
引用
收藏
页码:136 / 144
页数:8
相关论文
共 50 条
  • [31] Third Generation Neural Networks: Spiking Neural Networks
    Ghosh-Dastidar, Samanwoy
    Adeli, Hojjat
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, 2009, 61 : 167 - +
  • [32] SPIKING NEURAL NETWORKS
    Ghosh-Dastidar, Samanwoy
    Adeli, Hojjat
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2009, 19 (04) : 295 - 308
  • [33] Autonomous Learning Paradigm for Spiking Neural Networks
    Liu, Junxiu
    McDaid, Liam J.
    Harkin, Jim
    Karim, Shvan
    Johnson, Anju P.
    Halliday, David M.
    Tyrrell, Andy M.
    Timmis, Jon
    Millard, Alan G.
    Hilder, James
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: THEORETICAL NEURAL COMPUTATION, PT I, 2019, 11727 : 737 - 744
  • [34] Comparison of learning methods for spiking neural networks
    Kukin K.
    Sboev A.
    Optical Memory and Neural Networks (Information Optics), 2015, 24 (02): : 123 - 129
  • [35] Temporal Contrastive Learning for Spiking Neural Networks
    Qiu, Haonan
    Song, Zeyin
    Chen, Yanqi
    Ning, Munan
    Fang, Wei
    Sun, Tao
    Ma, Zhengyu
    Yuan, Li
    Tian, Yonghong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT X, 2024, 15025 : 422 - 436
  • [36] Learning long sequences in spiking neural networks
    Stan, Matei-Ioan
    Rhodes, Oliver
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [37] A reinforcement learning algorithm for spiking neural networks
    Florian, RV
    Seventh International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, Proceedings, 2005, : 299 - 306
  • [38] Learning rules in spiking neural networks: A survey
    Yi, Zexiang
    Lian, Jing
    Liu, Qidong
    Zhu, Hegui
    Liang, Dong
    Liu, Jizhao
    NEUROCOMPUTING, 2023, 531 : 163 - 179
  • [39] Supervised Learning in Multilayer Spiking Neural Networks
    Sporea, Ioana
    Gruening, Andre
    NEURAL COMPUTATION, 2013, 25 (02) : 473 - 509
  • [40] Learning in neural networks by reinforcement of irregular spiking
    Xie, XH
    Seung, HS
    PHYSICAL REVIEW E, 2004, 69 (04): : 10