Robust local stability of multilayer recurrent neural networks

被引:40
|
作者
Suykens, JAK [1 ]
De Moor, B [1 ]
Vandewalle, J [1 ]
机构
[1] Katholieke Univ Leuven, Dept Elect Engn, ESAT SISTA, B-3001 Heverlee, Belgium
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2000年 / 11卷 / 01期
关键词
dynamic backpropagation; linearization; matrix inequalities; NLq theory;
D O I
10.1109/72.822525
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we derive a condition for robust local stability of multilayer recurrent neural networks with two hidden layers, The stability condition follows from linking theory about linearization, robustness analysis of linear systems under nonlinear perturbation and matrix inequalities. A characterization of the basin of attraction of the origin is given in terms of the level set of a quadratic Lyapunov function. In a similar way like for NLq theory, local stability is imposed around the origin and the apparent basin of attraction is made large by applying the criterion, while the proven basin of attraction is relatively small due to conservatism of the criterion. Modifying dynamic backpropagation by the new stability condition is discussed and illustrated by simulation examples.
引用
收藏
页码:222 / 229
页数:8
相关论文
共 50 条
  • [31] REVISITING RECURRENT NEURAL NETWORKS FOR ROBUST ASR
    Vinyals, Oriol
    Ravuri, Suman V.
    Povey, Daniel
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 4085 - 4088
  • [32] LOCAL STABILITY CONDITIONS FOR DISCRETE-TIME CASCADE LOCALLY RECURRENT NEURAL NETWORKS
    Patan, Krzysztof
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2010, 20 (01) : 23 - 34
  • [33] Local Dynamics in Trained Recurrent Neural Networks
    Rivkind, Alexander
    Barak, Omri
    PHYSICAL REVIEW LETTERS, 2017, 118 (25)
  • [34] Recurrent Neural Networks for Local Model Prediction
    Cherif, Aymen
    Bone, Romuald
    ADVANCES IN COGNITIVE NEURODYNAMICS (II), 2011, : 621 - 628
  • [35] ON THE PROBLEM OF LOCAL MINIMA IN RECURRENT NEURAL NETWORKS
    BIANCHINI, M
    GORI, M
    MAGGINI, M
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02): : 167 - 172
  • [37] ROBUST STABILITY OF STOCHASTIC FUZZY IMPULSIVE RECURRENT NEURAL NETWORKS WITH TIME-VARYING DELAYS
    Ali, M. Syed
    IRANIAN JOURNAL OF FUZZY SYSTEMS, 2014, 11 (04): : 1 - 13
  • [38] Robust exponential stability analysis of a larger class of discrete-time recurrent neural networks
    Zhang Jian-hai
    Zhang Sen-lin
    Liu Mei-qin
    JOURNAL OF ZHEJIANG UNIVERSITY-SCIENCE A, 2007, 8 (12): : 1912 - 1920
  • [39] Robust exponential stability analysis of a larger class of discrete-time recurrent neural networks
    Jian-hai Zhang
    Sen-lin Zhang
    Mei-qin Liu
    Journal of Zhejiang University-SCIENCE A, 2007, 8 : 1912 - 1920
  • [40] Global stability of interval recurrent neural networks
    袁铸钢
    刘志远
    裴润
    申涛
    Journal of Beijing Institute of Technology, 2012, 21 (03) : 382 - 386