DSNNs: learning transfer from deep neural networks to spiking neural networks

被引:0
|
作者
Zhang L. [1 ,2 ,3 ]
Du Z. [1 ,2 ,3 ]
Li L. [4 ]
Chen Y. [1 ,2 ]
机构
[1] State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[2] Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[3] Cambricon Tech. Ltd, Beijing
[4] Institute of Software, Chinese Academy of Sciences, Beijing
来源
High Technology Letters | 2020年 / 26卷 / 02期
基金
中国国家自然科学基金;
关键词
Convert method; Deep leaning; Spatially folded network; Spiking neural network (SNN);
D O I
10.3772/j.issn.1006-6748.2020.02.002
中图分类号
学科分类号
摘要
Deep neural networks (DNNs) have drawn great attention as they perform the state-of-the-art results on many tasks. Compared to DNNs, spiking neural networks (SNNs), which are considered as the new generation of neural networks, fail to achieve comparable performance especially on tasks with large problem sizes. Many previous work tried to close the gap between DNNs and SNNs but used small networks on simple tasks. This work proposes a simple but effective way to construct deep spiking neural networks (DSNNs) by transferring the learned ability of DNNs to SNNs. DSNNs achieve comparable accuracy on large networks and complex datasets. Copyright © by HIGH TECHNOLOGY LETTERS PRESS.
引用
收藏
页码:136 / 144
页数:8
相关论文
共 50 条
  • [11] Spiking neural networks for deep learning and knowledge representation: Editorial
    Kasabov, Nikola K.
    NEURAL NETWORKS, 2019, 119 : 341 - 342
  • [12] An Unsupervised Learning Algorithm for Deep Recurrent Spiking Neural Networks
    Du, Pangao
    Lin, Xianghong
    Pi, Xiaomei
    Wang, Xiangwen
    2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 603 - 607
  • [13] Asymmetric Spatiotemporal Online Learning for Deep Spiking Neural Networks
    Xiao, Rong
    Ning, Limiao
    Wang, Yixuan
    Du, Huajun
    Wang, Sen
    Yan, Rui
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (05) : 1640 - 1647
  • [14] Temporal Dependent Local Learning for Deep Spiking Neural Networks
    Ma, Chenxiang
    Xu, Junhai
    Yu, Qiang
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [15] Learning algorithm for spiking neural networks
    Amin, HH
    Fujii, RH
    ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, 2005, 3610 : 456 - 465
  • [16] Supervised learning with spiking neural networks
    Xin, JG
    Embrechts, MJ
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 1772 - 1777
  • [17] Federated Learning With Spiking Neural Networks
    Venkatesha, Yeshwanth
    Kim, Youngeun
    Tassiulas, Leandros
    Panda, Priyadarshini
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 6183 - 6194
  • [18] Efficient learning in spiking neural networks
    Rast, Alexander
    Aoun, Mario Antoine
    Elia, Eleni G.
    Crook, Nigel
    NEUROCOMPUTING, 2024, 597
  • [19] Normative learning in spiking neural networks
    Jolivet, Renaud B.
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2024, 59 : 454 - 455
  • [20] Deep Phasor Networks: Connecting Conventional and Spiking Neural Networks
    Olin-Ammentorp, Wilkie
    Bazhenov, Maxim
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,