CHAOTIC DYNAMICS AND THE GEOMETRY OF THE ERROR SURFACE IN NEURAL NETWORKS

被引：1
|
作者：
CHOIE, YJ
KIM, S
LEE, CN
机构：
[1] Departments of Physics and Mathematics, POSTECH, Pohang
来源：
PHYSICA D | 1992年 / 55卷 / 1-2期
关键词：
D O I：
10.1016/0167-2789(92)90191-O
中图分类号：
O29 [应用数学];
学科分类号：
070104 ;
摘要：
We have observed transient periodic and chaotic oscillations in the learning process of a class of multi-layered neural networks called perceptrons. Based on the geometric picture of the widening ravines in the error surface, we have derived a delayed logistic mapping describing observed complex oscillations from fast dynamics transverse to the ravine and have shown that complex dynamics arises through delayed period doubling bifurcations. This illustrates that transient dynamics can be used to extract information on the geometry of the error surface in neural networks.
引用
收藏
页码：113 / 120
页数：8
相关论文
共 50 条
  • [31] Chaotic Synchronization and Neural Networks
    Vostokov, V. I.
    Radiophysics and Quantum Electronics, 1994, 37 (08):
  • [32] Chaotic neural networks and their applications
    He, YY
    Wang, LP
    PROCEEDINGS OF THE 3RD WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-5, 2000, : 826 - 830
  • [33] Multivariate Chaotic Models vs Neural Networks in Predicting Storm Surge Dynamics
    Siek, Michael
    Solomatine, Dimitri
    Velickov, Slavco
    2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 2112 - 2119
  • [34] Chaotic dynamics in iterated map neural networks with piecewise linear activation function
    Fundam Inf, 1 (31-50):
  • [35] A new type of self-organization associated with chaotic dynamics in neural networks
    Tsuda, I
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 1996, 7 (04) : 451 - 459
  • [36] Chaotic dynamics on large networks
    Sprott, J. C.
    CHAOS, 2008, 18 (02)
  • [37] The geometry of chaotic dynamics - a complex network perspective
    Donner, R. V.
    Heitzig, J.
    Donges, J. F.
    Zou, Y.
    Marwan, N.
    Kurths, J.
    EUROPEAN PHYSICAL JOURNAL B, 2011, 84 (04): : 653 - 672
  • [38] The geometry of chaotic dynamics — a complex network perspective
    R. V. Donner
    J. Heitzig
    J. F. Donges
    Y. Zou
    N. Marwan
    J. Kurths
    The European Physical Journal B, 2011, 84 : 653 - 672
  • [39] INFORMATION GEOMETRY OF NEURAL NETWORKS
    AMARI, S
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 1992, E75A (05) : 531 - 536
  • [40] A CHAOTIC ATTRACTOR WITH CELLULAR NEURAL NETWORKS
    FAN, Z
    NOSSEK, JA
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1991, 38 (07): : 811 - 812
12345