Memristor-based circuit design of BiLSTM network

被引:1
|
作者
Yang, Le [1 ]
Lei, Jun [1 ]
Cheng, Ming [1 ]
Ding, Zhixia [1 ]
Li, Sai [1 ]
Zeng, Zhigang [2 ]
机构
[1] Wuhan Inst Technol, Sch Elect & Informat Engn, Wuhan 430205, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Memristor-based neural network; Memristor-based circuit design; Bidirectional long short-term memory network; Normalization circuit; Resnet circuit; LSTM;
D O I
10.1016/j.neunet.2024.106780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The bidirectional long short-term memory (BiLSTM) network involves significant amount of parameter computations. This paper proposes the memristor-based bidirectional long short-term memory (MBiLSTM) network, with its capability of in-memory computing and parallel computing, can accelerates the parameter computations speed. The MBiLSTM network circuit is composed of normalization circuit, two memristor-based long short-term memory (LSTM) circuits, memristor-based resnet circuit, memristor-based dense circuitand winner-take-all (WTA) circuit. The voltage signals are scaled to the setting range by normalization circuit, memristor-based LSTM circuit is responsible for extracting features from the dataset, memristor-based resnet circuit can enhance the overall performance of the network, memristor-based dense circuit ensures that the final outputs dimension matches the dimension of the target signals, WTA circuit outputs the maximum voltage of memristor-based dense circuit. The effectiveness of the MBiLSTM network is validated through gait recognition experiment and handwritten digit recognition experiment. The stability, robustness and potential errors in the manufacturing process of memristance are analyzed.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Synthesis of Memristor-Based Chaotic Circuit
    Hrubos, Zdenek
    2012 35TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2012, : 416 - 420
  • [22] Overview of Memristor-Based Neural Network Design and Applications
    Ye, Longcheng
    Gao, Zhixuan
    Fu, Jinke
    Ren, Wang
    Yang, Cihui
    Wen, Jing
    Wan, Xiang
    Ren, Qingying
    Gu, Shipu
    Liu, Xiaoyan
    Lian, Xiaojuan
    Wang, Lei
    FRONTIERS IN PHYSICS, 2022, 10
  • [23] A Memristor-Based Neural Network Design for Associative Learning
    Wang, Siqi
    Dong, Boyi
    Fu, Yaoyao
    He, Yuhui
    Miao, Xiangshui
    2021 5TH IEEE ELECTRON DEVICES TECHNOLOGY & MANUFACTURING CONFERENCE (EDTM), 2021,
  • [24] Memristor-Based Circuit Implementations of Recognition Network and Recall Network With Forgetting Stages
    Yang, Le
    Zeng, Zhigang
    Huang, Yi
    Wen, Shiping
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2018, 10 (04) : 1133 - 1142
  • [25] A Memristor-Based Colpitts Oscillator Circuit
    Zhou, Ling
    You, Zhenzhen
    Liang, Xiaolin
    Li, Xiaowu
    MATHEMATICS, 2022, 10 (24)
  • [26] Analysis of memristor-based differentiating circuit
    Kirilov, Stoyan
    Zaykov, Ivan
    COMPEL-THE INTERNATIONAL JOURNAL FOR COMPUTATION AND MATHEMATICS IN ELECTRICAL AND ELECTRONIC ENGINEERING, 2020, 39 (03) : 683 - 690
  • [27] A memristor-based nonvolatile latch circuit
    Robinett, Warren
    Pickett, Matthew
    Borghetti, Julien
    Xia, Qiangfei
    Snider, Gregory S.
    Medeiros-Ribeiro, Gilberto
    Williams, R. Stanley
    NANOTECHNOLOGY, 2010, 21 (23)
  • [28] A memristor-based associative memory neural network circuit with emotion effect
    Wang, Chunhua
    Xu, Cong
    Sun, Jingru
    Deng, Quanli
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (15): : 10929 - 10944
  • [29] Memristor-Based Neural Network Circuit of Emotional Habituation With Contextual Dependency
    Sun, Junwei
    Zhao, Linhao
    Wen, Shiping
    Wang, Yanfeng
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (19) : 17382 - 17391
  • [30] A memristor-based associative memory neural network circuit with emotion effect
    Chunhua Wang
    Cong Xu
    Jingru Sun
    Quanli Deng
    Neural Computing and Applications, 2023, 35 (15) : 10929 - 10944