Existence and learning of oscillations in recurrent neural networks

被引:105
|
作者
Townley, S
Ilchmann, A
Weiss, MG
Mcclements, W
Ruiz, AC
Owens, DH
Prätzel-Wolters, D
机构
[1] Univ Exeter, Sch Math Sci, Exeter EX4 4QE, Devon, England
[2] Univ Kaiserslautern, Graduiertenkolleg Technol Math, D-67663 Kaiserslautern, Germany
[3] Univ Exeter, Ctr Syst & Control Engn, Exeter EX4 4QF, Devon, England
[4] Univ Sheffield, Dept Automat Control & Syst Engn, Sheffield S1 3JD, S Yorkshire, England
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2000年 / 11卷 / 01期
基金
英国工程与自然科学研究理事会;
关键词
learning systems; monotone dynamical systems; nonlinear dynamics; recurent neural networks;
D O I
10.1109/72.822523
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we study a particular class of n-node recurrent neural networks (RNN's), In the 3-node case we use monotone dynamical systems theory to show, for a well-defined set of parameters, that, generically, every orbit of the RNN is asymptotic to a periodic orbit. Then we investigate whether RNN's of this class can adapt their internal parameters so as to "learn" and then replicate autonomously tin feedback) certain external periodic signals. Our learning algorithm is similar to identification algorithms in adaptive control theory. The main feature of the algorithm is that global exponential convergence of parameters is guaranteed. We also obtain partial convergence results in the n-node case.
引用
收藏
页码:205 / 214
页数:10
相关论文
共 50 条
  • [1] Existence, learning, and replication of periodic motions in recurrent neural networks
    Ruiz, A
    Owens, DH
    Townley, S
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04): : 651 - 661
  • [2] Noise Induced Oscillations in Recurrent Neural Networks
    Sekine, Makoto
    Mino, Hiroyuki
    Durand, Dominique M.
    2009 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-20, 2009, : 1521 - +
  • [3] Existence of limit cycles in recurrent neural networks
    Ruiz, A
    Owens, DH
    Townley, S
    ISIE'96 - PROCEEDINGS OF THE IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS, VOLS 1 AND 2, 1996, : 104 - 108
  • [4] LEARNING IN RECURRENT NEURAL NETWORKS
    WHITE, H
    MATHEMATICAL SOCIAL SCIENCES, 1991, 22 (01) : 102 - 103
  • [5] Learning Queuing Networks by Recurrent Neural Networks
    Garbi, Giulio
    Incerto, Emilio
    Tribastone, Mirco
    PROCEEDINGS OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE'20), 2020, : 56 - 66
  • [6] Learning spiking neuronal networks with artificial neural networks: neural oscillations
    Zhang, Ruilin
    Wang, Zhongyi
    Wu, Tianyi
    Cai, Yuhang
    Tao, Louis
    Xiao, Zhuo-Cheng
    Li, Yao
    JOURNAL OF MATHEMATICAL BIOLOGY, 2024, 88 (06)
  • [7] Learning with recurrent neural networks - Conclusion
    不详
    LEARNING WITH RECURRENT NEURAL NETWORKS, 2000, 254 : 133 - 135
  • [8] Bayesian learning for recurrent neural networks
    Crucianu, M
    Boné, R
    de Beauville, JPA
    NEUROCOMPUTING, 2001, 36 (01) : 235 - 242
  • [9] LEARNING COMPACT RECURRENT NEURAL NETWORKS
    Lu, Zhiyun
    Sindhwani, Vikas
    Sainath, Tara N.
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 5960 - 5964
  • [10] Learning with recurrent neural networks - Introduction
    Hammer, B
    LEARNING WITH RECURRENT NEURAL NETWORKS, 2000, 254 : 1 - +