Memristor-based circuit design of BiLSTM network

被引:1
|
作者
Yang, Le [1 ]
Lei, Jun [1 ]
Cheng, Ming [1 ]
Ding, Zhixia [1 ]
Li, Sai [1 ]
Zeng, Zhigang [2 ]
机构
[1] Wuhan Inst Technol, Sch Elect & Informat Engn, Wuhan 430205, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Memristor-based neural network; Memristor-based circuit design; Bidirectional long short-term memory network; Normalization circuit; Resnet circuit; LSTM;
D O I
10.1016/j.neunet.2024.106780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The bidirectional long short-term memory (BiLSTM) network involves significant amount of parameter computations. This paper proposes the memristor-based bidirectional long short-term memory (MBiLSTM) network, with its capability of in-memory computing and parallel computing, can accelerates the parameter computations speed. The MBiLSTM network circuit is composed of normalization circuit, two memristor-based long short-term memory (LSTM) circuits, memristor-based resnet circuit, memristor-based dense circuitand winner-take-all (WTA) circuit. The voltage signals are scaled to the setting range by normalization circuit, memristor-based LSTM circuit is responsible for extracting features from the dataset, memristor-based resnet circuit can enhance the overall performance of the network, memristor-based dense circuit ensures that the final outputs dimension matches the dimension of the target signals, WTA circuit outputs the maximum voltage of memristor-based dense circuit. The effectiveness of the MBiLSTM network is validated through gait recognition experiment and handwritten digit recognition experiment. The stability, robustness and potential errors in the manufacturing process of memristance are analyzed.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Memristor-Based Neural Network Circuit of Associative Memory With Occasion Setting
    Han, Juntao
    Cheng, Xin
    Xie, Guangjun
    Sun, Junwei
    Liu, Gang
    Zhang, Zhang
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (03) : 1016 - 1026
  • [32] A Memristor-Based Scroll Chaotic System - Design, Analysis and Circuit Implementation
    Li, Huifang
    Wang, Lidan
    Duan, Shukai
    INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2014, 24 (07):
  • [33] A memristor-based circuit design and implementation for blocking on Pavlov associative memory
    Sichun Du
    Qing Deng
    Qinghui Hong
    Jun Li
    Haiyang Liu
    Chunhua Wang
    Neural Computing and Applications, 2022, 34 : 14745 - 14761
  • [34] A memristor-based circuit design and implementation for blocking on Pavlov associative memory
    Du, Sichun
    Deng, Qing
    Hong, Qinghui
    Li, Jun
    Liu, Haiyang
    Wang, Chunhua
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17): : 14745 - 14761
  • [35] A memristor-based circuit design for generalization and differentiation on Pavlov associative memory
    Shang, Meijia
    Wang, Xiaoping
    NEUROCOMPUTING, 2020, 389 : 18 - 26
  • [36] The Circuit Realization of a Neuromorphic Computing System with Memristor-Based Synapse Design
    Liu, Beiye
    Chen, Yiran
    Wysocki, Bryant
    Huang, Tingwen
    NEURAL INFORMATION PROCESSING, ICONIP 2012, PT I, 2012, 7663 : 357 - 365
  • [37] Circuit Design of Memristor-based GRU and its Applications in SOC Estimation
    Wang, Jiayang
    Ji, Xiaoyue
    Dong, Zhekang
    Zhang, Zhaowei
    Lai, Chun Sing
    Qi, Donglian
    2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [38] Memristor-based circuit design of episodic memory neural network and its application in hurricane category prediction
    Wan, Qiuzhen
    Liu, Jiong
    Liu, Tieqiao
    Sun, Kunliang
    Qin, Peng
    NEURAL NETWORKS, 2024, 174
  • [39] Memristor-Based Design of Sparse Compact Convolutional Neural Network
    Wen, Shiping
    Wei, Huaqiang
    Yan, Zheng
    Guo, Zhenyuan
    Yang, Yin
    Huang, Tingwen
    Chen, Yiran
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (03): : 1431 - 1440
  • [40] An aVLSI driving circuit for memristor-based STDP
    Acciarito, Simone
    Cristini, Alessandro
    Di Nunzio, Luca
    Khanal, Gaurav Mani
    Susi, Gianluca
    2016 12TH CONFERENCE ON PH.D. RESEARCH IN MICROELECTRONICS AND ELECTRONICS (PRIME), 2016,