Memristor-based circuit design of BiLSTM network

被引:1
|
作者
Yang, Le [1 ]
Lei, Jun [1 ]
Cheng, Ming [1 ]
Ding, Zhixia [1 ]
Li, Sai [1 ]
Zeng, Zhigang [2 ]
机构
[1] Wuhan Inst Technol, Sch Elect & Informat Engn, Wuhan 430205, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Memristor-based neural network; Memristor-based circuit design; Bidirectional long short-term memory network; Normalization circuit; Resnet circuit; LSTM;
D O I
10.1016/j.neunet.2024.106780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The bidirectional long short-term memory (BiLSTM) network involves significant amount of parameter computations. This paper proposes the memristor-based bidirectional long short-term memory (MBiLSTM) network, with its capability of in-memory computing and parallel computing, can accelerates the parameter computations speed. The MBiLSTM network circuit is composed of normalization circuit, two memristor-based long short-term memory (LSTM) circuits, memristor-based resnet circuit, memristor-based dense circuitand winner-take-all (WTA) circuit. The voltage signals are scaled to the setting range by normalization circuit, memristor-based LSTM circuit is responsible for extracting features from the dataset, memristor-based resnet circuit can enhance the overall performance of the network, memristor-based dense circuit ensures that the final outputs dimension matches the dimension of the target signals, WTA circuit outputs the maximum voltage of memristor-based dense circuit. The effectiveness of the MBiLSTM network is validated through gait recognition experiment and handwritten digit recognition experiment. The stability, robustness and potential errors in the manufacturing process of memristance are analyzed.
引用
收藏
页数:10
相关论文
共 50 条
  • [11] Emerging Memristor-Based Logic Circuit Design Approaches: A Review
    Vourkas, Ioannis
    Sirakoulis, Georgios Ch.
    IEEE CIRCUITS AND SYSTEMS MAGAZINE, 2016, 16 (03) : 15 - 30
  • [12] Memristor-Based Phase-Lead Controller Circuit Design
    Lin, Tsung-Chih
    Liao, Wei-Nan
    Balas, Valentina Emilia
    SOFT COMPUTING APPLICATIONS, 2013, 195 : 309 - 318
  • [13] Design and Analysis of Memristor-based Min-Max Circuit
    Amer, S. H.
    Madian, A. H.
    Emara, A. S.
    2015 IEEE CONFERENCE ON ELECTRONICS, CIRCUITS, AND SYSTEMS (ICECS), 2015, : 187 - 190
  • [14] Memristor-Based Circuit Design of Non Associative Learning Mechanism
    Sun, Junwei
    Wang, Yangyang
    Liu, Peng
    Wang, Yanfeng
    JOURNAL OF NANOELECTRONICS AND OPTOELECTRONICS, 2022, 17 (03) : 505 - 515
  • [15] The synchronisation of two floating memristor-based oscillators and the circuit design
    Hongmin Deng
    Qionghua Wang
    Pramana, 2019, 93
  • [16] A Logic Circuit Design for Perfecting Memristor-Based Material Implication
    Chen, Qiao
    Wang, Xiaoping
    Wan, Haibo
    Yang, Ran
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2017, 36 (02) : 279 - 284
  • [17] A memristor-based generalization and differentiation circuit design and the application in recognition
    Shang, Meijia
    Wang, Xiaoping
    Li, Mian
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7206 - 7211
  • [18] The synchronisation of two floating memristor-based oscillators and the circuit design
    Deng, Hongmin
    Wang, Qionghua
    PRAMANA-JOURNAL OF PHYSICS, 2019, 93 (03):
  • [19] Memristor-Based Chaotic Circuit Design on Image En/Decryption
    Hu, Qingqing
    Yu, Yongbin
    Men, Lefei
    Lei, Fei
    Zhang, Huan
    2016 31ST YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2016, : 56 - 60
  • [20] Special Memristor and Memristor-Based Compact Neuron Circuit
    Altan, Muhammet Alper
    Orman, Kamil
    Babacan, Yunus
    Yesil, Abdullah
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (05)