Reinforcement Learning in Memristive Spiking Neural Networks through Modulation of ReSuMe

被引：2

作者：

Ji, Xun ^{[1
]}

Zhang, Yaozhong ^{[1
]}

Li, Chuxi ^{[1
]}

Wu, Tanghong ^{[1
]}

Hu, Xiaofang ^{[1
]}

机构：

[1] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China

来源：

ADVANCES IN MATERIALS, MACHINERY, ELECTRONICS III | 2019年 / 2073卷

基金：

中国博士后科学基金; 中国国家自然科学基金;

关键词：

Reinforcement Learning; Spiking Neural Network; Remote Supervised Method; Memristor;

D O I：

10.1063/1.5090748

中图分类号：

T [工业技术];

学科分类号：

08 ;

摘要：

In this paper, a novel hardware-friendly reinforcement learning algorithm based on memristive spiking neural networks (MSNN-RL) is proposed. Neurons for spike coding are designed specifically to complete transformation between analog data and discrete spikes. Then, remote supervised method (ReSuMe) is used to combine SNN with basic reforcement learing (Sarsa). Besides, bionic memristive snynapses are designed to speed up ReSuMe. Furthermore, the circuit scheme of MSNN-RL is designed with modulation of memristor synapses. Finally, the application of MSNN-RL in acrobot system is discussed. Simulation results and analysis verify the effectiveness of the proposed algorithm (MSNN-RL) and show it is superior to traditional apporach.

引用

页数：9

共 50 条

[21] Memristive Spiking Neural Networks Trained with Unsupervised STDP
Zhou, Errui
Fang, Liang
Yang, Binbin
ELECTRONICS, 2018, 7 (12)
[22] Stochastic memristive devices for low cost learning of spatiotemporal signals in spiking neural networks
Fida, Aabid Amin
Mittal, Sparsh
Engineering Research Express, 2024, 6 (04):
[23] Soft-Reward Based Reinforcement Learning by Spiking Neural Networks
Shi, Weiya
ADVANCED RESEARCH ON INFORMATION SCIENCE, AUTOMATION AND MATERIAL SYSTEM, PTS 1-6, 2011, 219-220 : 770 - 773
[24] Exploring spiking neural networks for deep reinforcement learning in robotic tasks
Zanatta, Luca
Barchi, Francesco
Manoni, Simone
Tolu, Silvia
Bartolini, Andrea
Acquaviva, Andrea
SCIENTIFIC REPORTS, 2024, 14 (01):
[25] BrainQN: Enhancing the Robustness of Deep Reinforcement Learning with Spiking Neural Networks
Feng, Shuo
Cao, Jian
Ou, Zehong
Chen, Guang
Zhong, Yi
Wang, Zilin
Yan, Juntong
Chen, Jue
Wang, Bingsen
Zou, Chenglong
Feng, Zebang
Wang, Yuan
ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (09)
[26] A Fully Memristive Spiking Neural Network with Unsupervised Learning
Zhou, Peng
Choi, Dong-Uk
Eshraghian, Jason K.
Kang, Sung-Mo
2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 634 - 638
[27] Recharged Catalyst with Memristive Nitrogen Reduction Activity through Learning Networks of Spiking Neurons
Zhou, Gang
Li, Tinghui
Huang, Rong
Wang, Peifang
Hu, Bin
Li, Hao
Liu, Lizhe
Sun, Yan
JOURNAL OF THE AMERICAN CHEMICAL SOCIETY, 2021, 143 (14) : 5378 - 5385
[28] Accelerating Spiking Neural Networks using Memristive Crossbar Arrays
Bohnstingl, Thomas
Pantazi, Angeliki
Eleftheriou, Evangelos
2020 27TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2020,
[29] Toward Reflective Spiking Neural Networks Exploiting Memristive Devices
Makarov, Valeri A.
Lobov, Sergey A.
Shchanikov, Sergey
Mikhaylov, Alexey
Kazantsev, Viktor B.
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16
[30] Non-linear Memristive Synaptic Dynamics for Efficient Unsupervised Learning in Spiking Neural Networks
Brivio, Stefano
Ly, Denys R. B.
Vianello, Elisa
Spiga, Sabina
FRONTIERS IN NEUROSCIENCE, 2021, 15

← 1 2 3 4 5 →