Memristor-based circuit design of BiLSTM network

被引:1
|
作者
Yang, Le [1 ]
Lei, Jun [1 ]
Cheng, Ming [1 ]
Ding, Zhixia [1 ]
Li, Sai [1 ]
Zeng, Zhigang [2 ]
机构
[1] Wuhan Inst Technol, Sch Elect & Informat Engn, Wuhan 430205, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Memristor-based neural network; Memristor-based circuit design; Bidirectional long short-term memory network; Normalization circuit; Resnet circuit; LSTM;
D O I
10.1016/j.neunet.2024.106780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The bidirectional long short-term memory (BiLSTM) network involves significant amount of parameter computations. This paper proposes the memristor-based bidirectional long short-term memory (MBiLSTM) network, with its capability of in-memory computing and parallel computing, can accelerates the parameter computations speed. The MBiLSTM network circuit is composed of normalization circuit, two memristor-based long short-term memory (LSTM) circuits, memristor-based resnet circuit, memristor-based dense circuitand winner-take-all (WTA) circuit. The voltage signals are scaled to the setting range by normalization circuit, memristor-based LSTM circuit is responsible for extracting features from the dataset, memristor-based resnet circuit can enhance the overall performance of the network, memristor-based dense circuit ensures that the final outputs dimension matches the dimension of the target signals, WTA circuit outputs the maximum voltage of memristor-based dense circuit. The effectiveness of the MBiLSTM network is validated through gait recognition experiment and handwritten digit recognition experiment. The stability, robustness and potential errors in the manufacturing process of memristance are analyzed.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Memristor-Based Architectures for PFSCL Circuit Realizations
    Shikha, Neeta
    Pandey, Neeta
    Gupta, Kirti
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2023, 42 (08) : 4985 - 5012
  • [42] CMOS and Memristor-Based Neural Network Design for Position Detection
    Ebong, Idongesit E.
    Mazumder, Pinaki
    PROCEEDINGS OF THE IEEE, 2012, 100 (06) : 2050 - 2060
  • [43] Realization of memristor-based chaotic rossler circuit
    Taskiran, Zehra Gulru Cam
    Sedef, Herman
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2020, 35 (02): : 765 - 774
  • [44] Nondestructive Read Circuit for Memristor-Based Memories
    Reddy, Marreddy Guru Sai Prasad
    Ravi, V.
    NANOELECTRONIC MATERIALS AND DEVICES, VOL III, 2018, 466 : 123 - 131
  • [45] Complicated dynamics in a memristor-based RLC circuit
    Chunlai Li
    Yang Zhou
    Yanfeng Yang
    Hongmin Li
    Wei Feng
    Zhaoyu Li
    Youli Lu
    The European Physical Journal Special Topics, 2019, 228 : 1925 - 1941
  • [46] Complicated dynamics in a memristor-based RLC circuit
    Li, Chunlai
    Zhou, Yang
    Yang, Yanfeng
    Li, Hongmin
    Feng, Wei
    Li, Zhaoyu
    Lu, Youli
    EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2019, 228 (10): : 1925 - 1941
  • [47] Memristor-Based Conditioned Inhibition Neural Network Circuit With Blocking Generalization and Differentiation
    Sun, Junwei
    Gao, Peilong
    Wen, Shiping
    Liu, Peng
    Wang, Yanfeng
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (07): : 11259 - 11270
  • [48] Memristor-Based Architectures for PFSCL Circuit Realizations
    Neeta Shikha
    Kirti Pandey
    Circuits, Systems, and Signal Processing, 2023, 42 : 4985 - 5012
  • [49] Memristor-based Pulse Width Modulator Circuit
    Hassanein, A. M.
    Dakheel, M. M.
    Ahmed, R. F.
    Radwan, Ahmed G.
    2016 28TH INTERNATIONAL CONFERENCE ON MICROELECTRONICS (ICM 2016), 2016, : 353 - 356
  • [50] Memristor-Based Parallel Computing Circuit Optimization for LSTM Network Fault Diagnosis
    Sun, Junwei
    Cao, Yuhan
    Yue, Yi
    Wen, Shiping
    Wang, Yanfeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2025, 72 (02) : 907 - 917