A two-stage strategy for brain-inspired unsupervised learning in spiking neural networks

被引:1
|
作者
Cao, Zhen [1 ]
Ma, Chuanfeng [1 ]
Hou, Biao [1 ]
Chen, Xiaoyu [1 ]
Li, Leida [1 ]
Zhu, Hao [1 ]
Quan, Dou [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Xian 710126, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Two-stage learning strategy; Unsupervised learning; STDP; Spiking-SOM; Hybrid encoding; MODEL;
D O I
10.1016/j.neucom.2024.128655
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) are emerging as a promising model in the field of neuromorphic computing, offering possibilities for efficient bio-inspired computing. Unsupervised learning in SNNs plays a crucial role in exploring neural network dynamics and achieving efficient artificial intelligence systems. However, current unsupervised learning in SNNs mostly relies on single-stage learning strategies, which limits the possibility of combining diverse learning mechanisms and network structures, resulting in networks that lack flexibility and adaptability for low-power task processing. Inspired by the multi-stage and multi-strategy learning in the human brain, this paper proposes a two-stage learning strategy from coarse to fine to enhance the efficiency of unsupervised learning in SNNs. To quickly extract structural features from spike data in the first stage, we propose the Spiking-SOM algorithm, which effectively learns patterns in spike data and achieves clustering effects. Additionally, we integrate Rate encoding and Temporal encoding through a visual attention mechanism, where this hybrid encoding helps meet the need for rapid information processing in the first stage, while also aiding in detailed feature representation in the second stage. Compared to the traditional single-stage learning framework, this work maintains high accuracy in unsupervised classification while significantly reducing computational costs and speeding up training. This exploration offers a new direction for future learning frameworks in SNNs, helping to further improve the energy efficiency of the network.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Brain-Inspired Hardware for Artificial Intelligence: Accelerated Learning in a Physical-Model Spiking Neural Network
    Wunderlich, Timo
    Kungl, Akos F.
    Mueller, Eric
    Schemmel, Johannes
    Petrovici, Mihai
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: THEORETICAL NEURAL COMPUTATION, PT I, 2019, 11727 : 119 - 122
  • [42] Brain-inspired Multilayer Perceptron with Spiking Neurons
    Li, Wenshuo
    Chen, Hanting
    Guo, Jianyuan
    Zhang, Ziyang
    Wang, Yunhe
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 773 - 783
  • [43] Application of a Brain-Inspired Spiking Neural Network Architecture to Odor Data Classification
    Vanarse, Anup
    Espinosa-Ramos, Josafath Israel
    Osseiran, Adam
    Rassau, Alexander
    Kasabov, Nikola
    SENSORS, 2020, 20 (10)
  • [44] Flyintel - a Platform for Robot Navigation based on a Brain-Inspired Spiking Neural Network
    Yao, Huang-Yu
    Huang, Hsuan-Pei
    Huang, Yu-Chi
    Lo, Chung-Chuan
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2019), 2019, : 219 - 220
  • [45] Self-organizing neurons: toward brain-inspired unsupervised learning
    Khacef, Lyes
    Miramond, Benoit
    Barrientos, Diego
    Upegui, Andres
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [46] Dynamic-HDC: A Two-Stage Dynamic Inference Framework for Brain-Inspired Hyperdimensional Computing
    Chuang, Yu-Chuan
    Chang, Cheng-Yang
    Wu, An-Yeu
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2023, 13 (04) : 1125 - 1136
  • [47] Demonstration of Programmable Brain-Inspired Optoelectronic Neuron in Photonic Spiking Neural Network With Neural Heterogeneity
    Lee, Yun-Jhu
    On, Mehmet Berkay
    El Srouji, Luis
    Zhang, Li
    Abdelghany, Mahmoud
    Ben Yoo, S. J.
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2024, 42 (13) : 4542 - 4552
  • [48] Deep Learning of EEG Data in the NeuCube Brain-Inspired Spiking Neural Network Architecture for a Better Understanding of Depression
    Shah, Dhvani
    Wang, Grace Y.
    Doborjeh, Maryam
    Doborjeh, Zohreh
    Kasabov, Nikola
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 195 - 206
  • [49] Deep Learning of Explainable EEG Patterns as Dynamic Spatiotemporal Clusters and Rules in a Brain-Inspired Spiking Neural Network
    Doborjeh, Maryam
    Doborjeh, Zohreh
    Kasabov, Nikola
    Barati, Molood
    Wang, Grace Y.
    SENSORS, 2021, 21 (14)
  • [50] A brain-inspired algorithm for training highly sparse neural networks
    Zahra Atashgahi
    Joost Pieterse
    Shiwei Liu
    Decebal Constantin Mocanu
    Raymond Veldhuis
    Mykola Pechenizkiy
    Machine Learning, 2022, 111 : 4411 - 4452