Learning robust principal components from L1-norm maximization

被引:0
|
作者
Dingcheng FENG Feng CHEN Wenli XU Tsinghua National Laboratory for Information Science and TechnologyTsinghua UniversityBeijing China Department of AutomationTsinghua UniversityBeijing China [1 ,2 ,1 ,2 ,1 ,2 ,1 ,100084 ,2 ,100084 ]
机构
关键词
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
Principal component analysis(PCA) is fundamental in many pattern recognition applications.Much research has been performed to minimize the reconstruction error in L1-norm based reconstruction error minimization(L1-PCA-REM) since conventional L2-norm based PCA(L2-PCA) is sensitive to outliers.Recently,the variance maximization formulation of PCA with L1-norm(L1-PCA-VM) has been proposed,where new greedy and nongreedy solutions are developed.Armed with the gradient ascent perspective for optimization,we show that the L1-PCA-VM formulation is problematic in learning principal components and that only a greedy solution can achieve robustness motivation,which are verified by experiments on synthetic and real-world datasets.
引用
收藏
页码:901 / 908
页数:8
相关论文
共 50 条
  • [41] FFT calculation of the L1-norm principal component of a data matrix
    Colonnese, Stefania
    Markopoulos, Panos P.
    Scarano, Gaetano
    Pados, Dimitris A.
    SIGNAL PROCESSING, 2021, 189
  • [42] Robust Singular Values based on L1-norm PCA
    Le, Duc H.
    Markopoulos, Panos P.
    2022 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2022, : 67 - 72
  • [43] L1-Norm Principal Component Analysis Using Quaternion Rotations
    Faculty of Computer Science, Bialystok University of Technology, Wiejska Str. 45A, Bialystok
    15-351, Poland
    Proc. Conf. Comput. Sci. Intell. Syst., FedCSIS, (883-888):
  • [44] Robust polynomial classifier using L1-norm minimization
    K. Assaleh
    T. Shanableh
    Applied Intelligence, 2010, 33 : 330 - 339
  • [45] L1-Norm Sparse Learning and Its Application
    Zhu Xin-feng
    Li Bin
    Wang Jian-dong
    COMPUTER-AIDED DESIGN, MANUFACTURING, MODELING AND SIMULATION, PTS 1-2, 2011, 88-89 : 379 - +
  • [46] Pruning filters with L1-norm and capped L1-norm for CNN compression
    Kumar, Aakash
    Shaikh, Ali Muhammad
    Li, Yun
    Bilal, Hazrat
    Yin, Baoqun
    APPLIED INTELLIGENCE, 2021, 51 (02) : 1152 - 1160
  • [47] Pruning filters with L1-norm and capped L1-norm for CNN compression
    Aakash Kumar
    Ali Muhammad Shaikh
    Yun Li
    Hazrat Bilal
    Baoqun Yin
    Applied Intelligence, 2021, 51 : 1152 - 1160
  • [48] Robust projection twin extreme learning machines with capped L1-norm distance metric
    Yang, Yang
    Xue, Zhenxia
    Ma, Jun
    Chang, Xia
    NEUROCOMPUTING, 2023, 517 : 229 - 242
  • [49] Robust nonnegative mixed-norm algorithm with weighted l1-norm regularization
    Wu, Yifan
    Ni, Jingen
    CONFERENCE PROCEEDINGS OF 2019 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING (IEEE ICSPCC 2019), 2019,
  • [50] L1-norm Principal-Component Analysis via Bit Flipping
    Markopoulos, Panos P.
    Kundu, Sandipan
    Chamadia, Shubham
    Pados, Dimitris A.
    2016 15TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2016), 2016, : 326 - 332