A two-stage strategy for brain-inspired unsupervised learning in spiking neural networks

被引:1
|
作者
Cao, Zhen [1 ]
Ma, Chuanfeng [1 ]
Hou, Biao [1 ]
Chen, Xiaoyu [1 ]
Li, Leida [1 ]
Zhu, Hao [1 ]
Quan, Dou [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Xian 710126, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Two-stage learning strategy; Unsupervised learning; STDP; Spiking-SOM; Hybrid encoding; MODEL;
D O I
10.1016/j.neucom.2024.128655
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) are emerging as a promising model in the field of neuromorphic computing, offering possibilities for efficient bio-inspired computing. Unsupervised learning in SNNs plays a crucial role in exploring neural network dynamics and achieving efficient artificial intelligence systems. However, current unsupervised learning in SNNs mostly relies on single-stage learning strategies, which limits the possibility of combining diverse learning mechanisms and network structures, resulting in networks that lack flexibility and adaptability for low-power task processing. Inspired by the multi-stage and multi-strategy learning in the human brain, this paper proposes a two-stage learning strategy from coarse to fine to enhance the efficiency of unsupervised learning in SNNs. To quickly extract structural features from spike data in the first stage, we propose the Spiking-SOM algorithm, which effectively learns patterns in spike data and achieves clustering effects. Additionally, we integrate Rate encoding and Temporal encoding through a visual attention mechanism, where this hybrid encoding helps meet the need for rapid information processing in the first stage, while also aiding in detailed feature representation in the second stage. Compared to the traditional single-stage learning framework, this work maintains high accuracy in unsupervised classification while significantly reducing computational costs and speeding up training. This exploration offers a new direction for future learning frameworks in SNNs, helping to further improve the energy efficiency of the network.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Brain-Inspired Spiking Neural Network Using Superconducting Devices
    Zhang, Huilin
    Gang, Chen
    Xu, Chen
    Gong, Guoliang
    Lu, Huaxiang
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (01): : 271 - 277
  • [22] BrainCog: A spiking neural network based, brain-inspired cognitive intelligence engine for brain-inspired AI and brain simulation
    Zeng, Yi
    Zhao, Dongcheng
    Zhao, Feifei
    Shen, Guobin
    Dong, Yiting
    Lu, Enmeng
    Zhang, Qian
    Sun, Yinqian
    Liang, Qian
    Zhao, Yuxuan
    Zhao, Zhuoya
    Fang, Hongjian
    Wang, Yuwei
    Li, Yang
    Liu, Xin
    Du, Chengcheng
    Kong, Qingqun
    Ruan, Zizhe
    Bi, Weida
    PATTERNS, 2023, 4 (08):
  • [23] BRAIN-INSPIRED SPIKING NEURAL NETWORKS FOR WI-FI BASED HUMAN ACTIVITY RECOGNITION
    Tan, Yee Leong
    Wong, Yan Chiew
    Radzi, Syafeeza Ahmad
    JORDANIAN JOURNAL OF COMPUTERS AND INFORMATION TECHNOLOGY, 2021, 7 (04): : 363 - 372
  • [24] Brain-inspired chaotic spiking backpropagation
    Zijian Wang
    Peng Tao
    Luonan Chen
    National Science Review, 2024, 11 (06) : 169 - 179
  • [25] Brain-inspired chaotic spiking backpropagation
    Wang, Zijian
    Tao, Peng
    Chen, Luonan
    NATIONAL SCIENCE REVIEW, 2024, 11 (06)
  • [26] Stylistic Composition of Melodies Based on a Brain-Inspired Spiking Neural Network
    Liang, Qian
    Zeng, Yi
    FRONTIERS IN SYSTEMS NEUROSCIENCE, 2021, 15
  • [27] A brain-inspired robot pain model based on a spiking neural network
    Feng, Hui
    Zeng, Yi
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [28] Brain-Inspired Online Adaptation for Remote Sensing With Spiking Neural Network
    Duan, Dexin
    Liu, Peilin
    Hui, Bingwei
    Wen, Fei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [29] Brain-Inspired Spiking Neural Network Controller for a Neurorobotic Whisker System
    Antonietti, Alberto
    Geminiani, Alice
    Negri, Edoardo
    D'Angelo, Egidio
    Casellato, Claudia
    Pedrocchi, Alessandra
    Frontiers in Neurorobotics, 2022, 16
  • [30] Brain-Inspired Spiking Neural Network Controller for a Neurorobotic Whisker System
    Antonietti, Alberto
    Geminiani, Alice
    Negri, Edoardo
    D'Angelo, Egidio
    Casellato, Claudia
    Pedrocchi, Alessandra
    FRONTIERS IN NEUROROBOTICS, 2022, 16