A two-stage strategy for brain-inspired unsupervised learning in spiking neural networks

被引:1
|
作者
Cao, Zhen [1 ]
Ma, Chuanfeng [1 ]
Hou, Biao [1 ]
Chen, Xiaoyu [1 ]
Li, Leida [1 ]
Zhu, Hao [1 ]
Quan, Dou [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Xian 710126, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Two-stage learning strategy; Unsupervised learning; STDP; Spiking-SOM; Hybrid encoding; MODEL;
D O I
10.1016/j.neucom.2024.128655
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) are emerging as a promising model in the field of neuromorphic computing, offering possibilities for efficient bio-inspired computing. Unsupervised learning in SNNs plays a crucial role in exploring neural network dynamics and achieving efficient artificial intelligence systems. However, current unsupervised learning in SNNs mostly relies on single-stage learning strategies, which limits the possibility of combining diverse learning mechanisms and network structures, resulting in networks that lack flexibility and adaptability for low-power task processing. Inspired by the multi-stage and multi-strategy learning in the human brain, this paper proposes a two-stage learning strategy from coarse to fine to enhance the efficiency of unsupervised learning in SNNs. To quickly extract structural features from spike data in the first stage, we propose the Spiking-SOM algorithm, which effectively learns patterns in spike data and achieves clustering effects. Additionally, we integrate Rate encoding and Temporal encoding through a visual attention mechanism, where this hybrid encoding helps meet the need for rapid information processing in the first stage, while also aiding in detailed feature representation in the second stage. Compared to the traditional single-stage learning framework, this work maintains high accuracy in unsupervised classification while significantly reducing computational costs and speeding up training. This exploration offers a new direction for future learning frameworks in SNNs, helping to further improve the energy efficiency of the network.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Brain-Inspired Architecture for Spiking Neural Networks
    Tang, Fengzhen
    Zhang, Junhuai
    Zhang, Chi
    Liu, Lianqing
    BIOMIMETICS, 2024, 9 (10)
  • [2] Deep Learning in Spiking Neural Networks for Brain-Inspired Artificial intelligence
    Kasabov, Nikola
    COMPUTER SYSTEMS AND TECHNOLOGIES (COMPSYSTECH'18), 2018, 1641 : 1 - 1
  • [3] Brain-inspired neural circuit evolution for spiking neural networks
    Shen, Guobin
    Zhao, Dongcheng
    Dong, Yiting
    Zeng, Yi
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2023, 120 (39)
  • [4] Brain-inspired Evolutionary Architectures for Spiking Neural Networks
    Pan W.
    Zhao F.
    Zhao Z.
    Zeng Y.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (11): : 1 - 10
  • [5] Brain-inspired Balanced Tuning for Spiking Neural Networks
    Zhang, Tielin
    Zeng, Yi
    Zhao, Dongcheng
    Xu, Bo
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 1653 - 1659
  • [6] A CMOS Spiking Neuron for Brain-Inspired Neural Networks With Resistive Synapses and In Situ Learning
    Wu, Xinyu
    Saxena, Vishal
    Zhu, Kehan
    Balagopal, Sakkarapani
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2015, 62 (11) : 1088 - 1092
  • [7] Brain-Inspired Spiking Neural Network for Online Unsupervised Time Series Prediction
    Chakraborty, Biswadeep
    Mukhopadhyay, Saibal
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [8] A Brain-Inspired Causal Reasoning Model Based on Spiking Neural Networks
    Fang, Hongjian
    Zeng, Yi
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] A brain-inspired spiking neural network model with temporal encoding and learning
    Yu, Qiang
    Tang, Huajin
    Tan, Kay Chen
    Yu, Haoyong
    NEUROCOMPUTING, 2014, 138 : 3 - 13
  • [10] Modeling-based design of brain-inspired spiking neural networks with RRAM learning synapses
    Pedretti, G.
    Bianchi, S.
    Milo, V.
    Calderoni, A.
    Ramaswamy, N.
    Ielmini, D.
    2017 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2017,