The dynamics of on-line principal component analysis

被引:9
|
作者
Biehl, M [1 ]
Schlosser, E [1 ]
机构
[1] Univ Wurzburg, Inst Theoret Phys, D-97074 Wurzburg, Germany
来源
关键词
D O I
10.1088/0305-4470/31/5/002
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The learning dynamics of an on-line algorithm for principal component analysis is described exactly in the thermodynamic limit by means of coupled ordinary differential equations for a set of order parameters. It is demonstrated that learning is delayed significantly because existing symmetries among student vectors have to be broken. A closely related effect is the perfect or partial loss of initial knowledge in the course of learning. The analysis shows that different learning rates for the student vectors improve the performance of the algorithm drastically.
引用
收藏
页码:L97 / L103
页数:7
相关论文
共 50 条
  • [21] An On-line Calibration Monitoring Technique Using Support Vector Regression and Principal Component Analysis
    Seo, In-Yong
    Kim, Seong-Jun
    2008 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE FOR MODELLING CONTROL & AUTOMATION, VOLS 1 AND 2, 2008, : 663 - +
  • [22] On-line monitoring of batch processes using generalized additive kernel principal component analysis
    Yao, Ma
    Wang, Huangang
    JOURNAL OF PROCESS CONTROL, 2015, 28 : 56 - 72
  • [23] On-line batch process monitoring using a consecutively updated multiway principal component analysis model
    Lee, JM
    Yoo, C
    Lee, IB
    COMPUTERS & CHEMICAL ENGINEERING, 2003, 27 (12) : 1903 - 1912
  • [24] Moving object detection based on on-line block-robust principal component analysis decomposition
    Yang, Biao
    Cao, Jinmeng
    Zou, Ling
    MODERN PHYSICS LETTERS B, 2017, 31 (19-21):
  • [25] A new soft sensor based on dynamic principal component analysis and on-line Potential Fuzzy Clustering
    Amanian, Karim
    Salahshoor, Karim
    Jafari, Mohammad Reza
    Mosallaie, Mohsen
    PROCEEDINGS OF 2008 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL, VOLS 1 AND 2, 2008, : 137 - 141
  • [26] On-line adaptive principal component extraction algorithms using iteration approach
    Sun, Jian
    Chai, Yi
    Guo, Maoyun
    Li, H. F.
    SIGNAL PROCESSING, 2012, 92 (04) : 1044 - 1068
  • [27] On-Line Insulation Monitoring Method of Substation Power Cable Based on Distributed Current Principal Component Analysis
    Yang, Haobo
    Wang, Jingang
    Zhao, Pengcheng
    Yu, Chuanxiang
    You, Hongkang
    Dou, Jinyao
    ENERGIES, 2025, 18 (03)
  • [28] Principal Component Analysis for Protein Folding Dynamics
    Maisuradze, Gia G.
    Liwo, Adam
    Scheraga, Harold A.
    JOURNAL OF MOLECULAR BIOLOGY, 2009, 385 (01) : 312 - 329
  • [29] On-line Handwritten Character Recognition System for Kannada using Principal Component Analysis Approach for Handheld Devices
    Prasad, Keerthi G.
    Khan, Imran
    Chanukotimath, Naveen R.
    Khan, Firoz
    PROCEEDINGS OF THE 2012 WORLD CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGIES, 2012, : 675 - 678
  • [30] Advanced process monitoring using an on-line non-linear multiscale principal component analysis methodology
    Fourie, SH
    de Vaal, P
    COMPUTERS & CHEMICAL ENGINEERING, 2000, 24 (2-7) : 755 - 760