DSNNs: learning transfer from deep neural networks to spiking neural networks

被引:0
|
作者
Zhang L. [1 ,2 ,3 ]
Du Z. [1 ,2 ,3 ]
Li L. [4 ]
Chen Y. [1 ,2 ]
机构
[1] State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[2] Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[3] Cambricon Tech. Ltd, Beijing
[4] Institute of Software, Chinese Academy of Sciences, Beijing
来源
High Technology Letters | 2020年 / 26卷 / 02期
基金
中国国家自然科学基金;
关键词
Convert method; Deep leaning; Spatially folded network; Spiking neural network (SNN);
D O I
10.3772/j.issn.1006-6748.2020.02.002
中图分类号
学科分类号
摘要
Deep neural networks (DNNs) have drawn great attention as they perform the state-of-the-art results on many tasks. Compared to DNNs, spiking neural networks (SNNs), which are considered as the new generation of neural networks, fail to achieve comparable performance especially on tasks with large problem sizes. Many previous work tried to close the gap between DNNs and SNNs but used small networks on simple tasks. This work proposes a simple but effective way to construct deep spiking neural networks (DSNNs) by transferring the learned ability of DNNs to SNNs. DSNNs achieve comparable accuracy on large networks and complex datasets. Copyright © by HIGH TECHNOLOGY LETTERS PRESS.
引用
收藏
页码:136 / 144
页数:8
相关论文
共 50 条
  • [21] Neuromorphic Architectures for Spiking Deep Neural Networks
    Indiveri, Giacomo
    Corradi, Federico
    Qiao, Ning
    2015 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2015,
  • [22] Integrating Spiking Neural Networks and Deep Learning Algorithms on the Neurorobotics Platform
    Stentiford, Rachael
    Knowles, Thomas C.
    Feldotto, Benedikt
    Ergene, Deniz
    Morin, Fabrice O.
    Pearson, Martin J.
    BIOMIMETIC AND BIOHYBRID SYSTEMS, LIVING MACHINES 2022, 2022, 13548 : 68 - 79
  • [23] An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks
    Zhu, Xiaolei
    Zhao, Baixin
    Ma, De
    Tang, Huajin
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (03) : 847 - 856
  • [24] Direct learning-based deep spiking neural networks: a review
    Guo, Yufei
    Huang, Xuhui
    Ma, Zhe
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [25] Exploring spiking neural networks for deep reinforcement learning in robotic tasks
    Zanatta, Luca
    Barchi, Francesco
    Manoni, Simone
    Tolu, Silvia
    Bartolini, Andrea
    Acquaviva, Andrea
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [26] Progressive Tandem Learning for Pattern Recognition With Deep Spiking Neural Networks
    Wu, Jibin
    Xu, Chenglin
    Han, Xiao
    Zhou, Daquan
    Zhang, Malu
    Li, Haizhou
    Tan, Kay Chen
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) : 7824 - 7840
  • [27] BrainQN: Enhancing the Robustness of Deep Reinforcement Learning with Spiking Neural Networks
    Feng, Shuo
    Cao, Jian
    Ou, Zehong
    Chen, Guang
    Zhong, Yi
    Wang, Zilin
    Yan, Juntong
    Chen, Jue
    Wang, Bingsen
    Zou, Chenglong
    Feng, Zebang
    Wang, Yuan
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (09)
  • [28] Transfer Learning on Deep Neural Networks to Detect Pornography
    Albahli, Saleh
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2022, 43 (02): : 701 - 717
  • [29] A Deep Learning Framework for Automated Transfer Learning of Neural Networks
    Balaiah, Thanasekhar
    Jeyadoss, Timothy Jones Thomas
    Thirumurugan, Sainee
    Ravi, Rahul Chander
    2019 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC 2019), 2019, : 428 - 432
  • [30] Transfer Learning from Deep Neural Networks for Predicting Student Performance
    Tsiakmaki, Maria
    Kostopoulos, Georgios
    Kotsiantis, Sotiris
    Ragos, Omiros
    APPLIED SCIENCES-BASEL, 2020, 10 (06):