Robust Principal Component Analysis using Density Power Divergence

被引:0
|
作者
Roy, Subhrajyoty [1 ]
Basu, Ayanendranath [1 ]
Ghosh, Abhik [1 ]
机构
[1] Indian Stat Inst, Interdisciplinary Stat Res Unit, Kolkata 700108, West Bengal, India
关键词
Robust PCA; Eigen Decomposition; Matrix Factorization; Density Power Divergence; Breakdown Point; PROJECTION-PURSUIT APPROACH; DISPERSION MATRICES; OPTIMIZATION; ESTIMATORS; FRAMEWORK; LOCATION; PCA;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Principal component analysis (PCA) is a widely employed statistical tool used primarilyfor dimensionality reduction. However, it is known to be adversely affected by the presenceof outlying observations in the sample, which is quite common. Robust PCA methodsusing M-estimators have theoretical benefits, but their robustness drop substantially forhigh dimensional data. On the other end of the spectrum, robust PCA algorithms solv-ing principal component pursuit or similar optimization problems have high breakdown,but lack theoretical richness and demand high computational power compared to the M-estimators. We introduce a novel robust PCA estimator based on the minimum densitypower divergence estimator. This combines the theoretical strength of the M-estimatorsand the minimum divergence estimators with a high breakdown guarantee regardless ofdata dimension. We present a computationally efficient algorithm for this estimate. Ourtheoretical findings are supported by extensive simulations and comparisons with existingrobust PCA methods. We also showcase the proposed algorithm's applicability on twobenchmark data sets and a credit card transactions data set for fraud detection.
引用
收藏
页数:40
相关论文
共 50 条
  • [1] ROBUST PRINCIPAL COMPONENT ANALYSIS USING ALPHA DIVERGENCE
    Rekavandi, Aref Miri
    Seghouane, Abd-Krim
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 6 - 15
  • [2] Robust Bayes estimation using the density power divergence
    Abhik Ghosh
    Ayanendranath Basu
    Annals of the Institute of Statistical Mathematics, 2016, 68 : 413 - 437
  • [3] Robust Bayes estimation using the density power divergence
    Ghosh, Abhik
    Basu, Ayanendranath
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2016, 68 (02) : 413 - 437
  • [4] Entropic principal component analysis using Cauchy–Schwarz divergence
    Eduardo K. Nakao
    Alexandre L. M. Levada
    Knowledge and Information Systems, 2023, 65 : 5375 - 5385
  • [5] Robust Principal Component Analysis for Power Transformed Compositional Data
    Scealy, J. L.
    de Caritat, Patrice
    Grunsky, Eric C.
    Tsagris, Michail T.
    Welsh, A. H.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2015, 110 (509) : 136 - 148
  • [6] Robust principal component analysis
    Partridge, Matthew
    Jabri, Marwan
    Neural Networks for Signal Processing - Proceedings of the IEEE Workshop, 2000, 1 : 289 - 298
  • [7] A ROBUST PRINCIPAL COMPONENT ANALYSIS
    RUYMGAART, FH
    JOURNAL OF MULTIVARIATE ANALYSIS, 1981, 11 (04) : 485 - 497
  • [8] Robust Principal Component Analysis?
    Candes, Emmanuel J.
    Li, Xiaodong
    Ma, Yi
    Wright, John
    JOURNAL OF THE ACM, 2011, 58 (03)
  • [9] A robust principal component analysis
    Ibazizen, M
    Dauxois, J
    STATISTICS, 2003, 37 (01) : 73 - 83
  • [10] Robust principal component analysis
    Partridge, M
    Jabri, M
    NEURAL NETWORKS FOR SIGNAL PROCESSING X, VOLS 1 AND 2, PROCEEDINGS, 2000, : 289 - 298