A survey on LSTM memristive neural network architectures and applications

被引:281
|
作者
Smagulova, Kamilya [1 ]
James, Alex Pappachen [1 ]
机构
[1] Nazarbayev Univ, 53 Kabanbay Batyr Ave, Nur Sultan, Kazakhstan
来源
关键词
D O I
10.1140/epjst/e2019-900046-x
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The recurrent neural networks (RNN) found to be an effective tool for approximating dynamic systems dealing with time and order dependent data such as video, audio and others. Long short-term memory (LSTM) is a recurrent neural network with a state memory and multilayer cell structure. Hardware acceleration of LSTM using memristor circuit is an emerging topic of study. In this work, we look at history and reasons why LSTM neural network has been developed. We provide a tutorial survey on the existing LSTM methods and highlight the recent developments in memristive LSTM architectures.
引用
收藏
页码:2313 / 2324
页数:12
相关论文
共 50 条
  • [11] NEURAL-NETWORK ARCHITECTURES FOR INDUSTRIAL APPLICATIONS
    DEVENA, L
    MASTRETTA, M
    RICCIARDIELLO, L
    BIOSENSORS & BIOELECTRONICS, 1995, 10 (1-2): : 231 - 236
  • [12] Framewise phoneme classification with bidirectional LSTM and other neural network architectures
    Graves, A
    Schmidhuber, J
    NEURAL NETWORKS, 2005, 18 (5-6) : 602 - 610
  • [13] Adaptive sparse coding based on memristive neural network with applications
    Ji, Xun
    Hu, Xiaofang
    Zhou, Yue
    Dong, Zhekang
    Duan, Shukai
    COGNITIVE NEURODYNAMICS, 2019, 13 (05) : 475 - 488
  • [14] Memristive Chebyshev Neural Network and Its Applications in Function Approximation
    Wang, Lidan
    Duan, Meitao
    Duan, Shukai
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013
  • [15] A Memristive Multilayer Cellular Neural Network With Applications to Image Processing
    Hu, Xiaofang
    Feng, Gang
    Duan, Shukai
    Liu, Lu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (08) : 1889 - 1901
  • [16] Adaptive sparse coding based on memristive neural network with applications
    Xun Ji
    Xiaofang Hu
    Yue Zhou
    Zhekang Dong
    Shukai Duan
    Cognitive Neurodynamics, 2019, 13 : 475 - 488
  • [17] A Survey on Recurrent Neural Network Architectures for Sequential Learning
    Prakash, B. Shiva
    Sanjeev, K., V
    Prakash, Ramesh
    Chandrasekaran, K.
    SOFT COMPUTING FOR PROBLEM SOLVING, 2019, 817 : 57 - 66
  • [18] A Survey on Network Architectures and Applications for Nanosat and UAV Swarms
    Bacco, Manlio
    Cassara, Pietro
    Colucci, Marco
    Gotta, Alberto
    Marchese, Mario
    Patrone, Fabio
    WIRELESS AND SATELLITE SYSTEMS, WISATS 2017, 2018, 231 : 75 - 85
  • [19] Application of an Innovative Convolutional/LSTM Neural Network for Computing Resource Allocation in NFV Network Architectures
    Eramo, Vincenzo
    Catena, Tiziana
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (03): : 2929 - 2943
  • [20] Survey of random neural network applications
    Bakircioglu, H
    Koçak, T
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2000, 126 (02) : 319 - 330