A two-stage strategy for brain-inspired unsupervised learning in spiking neural networks

被引:1
|
作者
Cao, Zhen [1 ]
Ma, Chuanfeng [1 ]
Hou, Biao [1 ]
Chen, Xiaoyu [1 ]
Li, Leida [1 ]
Zhu, Hao [1 ]
Quan, Dou [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Xian 710126, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Two-stage learning strategy; Unsupervised learning; STDP; Spiking-SOM; Hybrid encoding; MODEL;
D O I
10.1016/j.neucom.2024.128655
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) are emerging as a promising model in the field of neuromorphic computing, offering possibilities for efficient bio-inspired computing. Unsupervised learning in SNNs plays a crucial role in exploring neural network dynamics and achieving efficient artificial intelligence systems. However, current unsupervised learning in SNNs mostly relies on single-stage learning strategies, which limits the possibility of combining diverse learning mechanisms and network structures, resulting in networks that lack flexibility and adaptability for low-power task processing. Inspired by the multi-stage and multi-strategy learning in the human brain, this paper proposes a two-stage learning strategy from coarse to fine to enhance the efficiency of unsupervised learning in SNNs. To quickly extract structural features from spike data in the first stage, we propose the Spiking-SOM algorithm, which effectively learns patterns in spike data and achieves clustering effects. Additionally, we integrate Rate encoding and Temporal encoding through a visual attention mechanism, where this hybrid encoding helps meet the need for rapid information processing in the first stage, while also aiding in detailed feature representation in the second stage. Compared to the traditional single-stage learning framework, this work maintains high accuracy in unsupervised classification while significantly reducing computational costs and speeding up training. This exploration offers a new direction for future learning frameworks in SNNs, helping to further improve the energy efficiency of the network.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Demonstration of Neural Heterogeneity with Programmable Brain-Inspired Optoelectronic Spiking Neurons
    Lee, Yun-Jhu
    On, Mehmet Berkay
    El Srouji, Luis
    Zhang, Li
    Abdelghany, Mahmoud
    Ben Yoo, S. J.
    2024 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION, OFC, 2024,
  • [32] Studying Transfer of Learning using a Brain-Inspired Spiking Neural Network in the Context of Learning a New Programming Language
    Fard, Mojgan Hafezi
    Petrova, Krassie
    Kasabov, Nikola
    Wang, Grace Y.
    2021 IEEE ASIA-PACIFIC CONFERENCE ON COMPUTER SCIENCE AND DATA ENGINEERING (CSDE), 2021,
  • [33] Brain-inspired wiring economics for artificial neural networks
    Zhang, Xin-Jie
    Moore, Jack Murdoch
    Gao, Ting-Ting
    Zhang, Xiaozhu
    Yan, Gang
    PNAS NEXUS, 2025, 4 (01):
  • [34] A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost
    Zhang, Tielin
    Cheng, Xiang
    Jia, Shuncheng
    Li, Chengyu T.
    Poo, Mu-ming
    Xu, Bo
    SCIENCE ADVANCES, 2023, 9 (34)
  • [35] Toward Cognitive Machines: Evaluating Single Device Based Spiking Neural Networks for Brain-Inspired Computing
    Bashir, Faisal
    Alzahrani, Ali
    Abbas, Haider
    Zahoor, Furqan
    ACS APPLIED ELECTRONIC MATERIALS, 2025, 7 (04) : 1329 - 1341
  • [36] EEG Pattern Recognition using Brain-Inspired Spiking Neural Networks for Modelling Human Decision Processes
    Doborjeh, Zohreh G.
    Doborjeh, Maryam
    Kasabov, Nikola
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [37] Advancing brain-inspired computing with hybrid neural networks
    Liu, Faqiang
    Zheng, Hao
    Ma, Songchen
    Zhang, Weihao
    Liu, Xue
    Chua, Yansong
    Shi, Luping
    Zhao, Rong
    NATIONAL SCIENCE REVIEW, 2024, 11 (05)
  • [38] Temporal-Sequential Learning With a Brain-Inspired Spiking Neural Network and Its Application to Musical Memory
    Liang, Qian
    Zeng, Yi
    Xu, Bo
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2020, 14 (14)
  • [39] Advancing brain-inspired computing with hybrid neural networks
    Faqiang Liu
    Hao Zheng
    Songchen Ma
    Weihao Zhang
    Xue Liu
    Yansong Chua
    Luping Shi
    Rong Zhao
    National Science Review, 2024, 11 (05) : 56 - 71
  • [40] Optimizing information processing in brain-inspired neural networks
    Paprocki, B.
    Pregowska, A.
    Szczepanski, J.
    BULLETIN OF THE POLISH ACADEMY OF SCIENCES-TECHNICAL SCIENCES, 2020, 68 (02) : 225 - 233