CUTTING PLANE GENERATION THROUGH SPARSE PRINCIPAL COMPONENT ANALYSIS

被引:2
|
作者
Dey, Santanu S. [1 ]
Kazachkov, Aleksandr [2 ]
Lodi, Andrea [3 ,4 ]
Munoz, Gonzalo [5 ]
机构
[1] Georgia Inst Technol, H Milton Stewart Sch Ind & Syst Engn, Atlanta, GA 30332 USA
[2] Univ Florida, Gainesville, FL 32611 USA
[3] Polytech Montreal, CERC, Montreal, PQ H3C 3A7, Canada
[4] Cornell Tech & Technion IIT, Jacobs Technion Cornell Inst, New York, NY 10044 USA
[5] Univ OHiggins, Rancagua 2940032, Chile
关键词
quadratically constrained quadratic programs; nonconvex optimization; sparse cutting planes; sparse principal component analysis; QUADRATIC-PROGRAMMING PROBLEMS; POWER METHOD; OPTIMIZATION; RELAXATIONS; ALGORITHM; FACETS; CUTS;
D O I
10.1137/21M1399956
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Quadratically constrained quadratic programs (QCQPs) are optimization models whose remarkable expressiveness have made them a cornerstone of methodological research for non convex optimization problems. However, modern methods to solve a general QCQP fail to scale, encountering computational challenges even with just a few hundred variables. Specifically, a semi definite programming (SDP) relaxation is typically employed, which provides strong dual bounds for QCQPs but relies on memory-intensive algorithms. An appealing alternative is to replace the SDP with an easier-to-solve linear programming relaxation while still achieving strong bounds. In this work, we make advances toward achieving this goal by developing a computationally efficient linear cutting plane algorithm that emulates the SDP-based approximations of nonconvex QCQPs. The cutting planes are required to be sparse, in order to ensure a numerically attractive approximation, and efficiently computable. We present a novel connection between such sparse cut generation and the sparse principal component analysis problem in statistics, which allows us to achieve these two goals. We show extensive computational results advocating for the use of our approach.
引用
收藏
页码:1319 / 1343
页数:25
相关论文
共 50 条
  • [41] Bayesian robust principal component analysis with structured sparse component
    Han, Ningning
    Song, Yumeng
    Song, Zhanjie
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2017, 109 : 144 - 158
  • [42] Generalized power method for sparse principal component analysis
    Journée, Michel
    Nesterov, Yurii
    Richtárik, Peter
    Sepulchre, Rodolphe
    Journal of Machine Learning Research, 2010, 11 : 517 - 553
  • [43] Comparison of sparse Kernel Principal Component Analysis methods
    Gou, Zhen Kun
    Feng, JunKang
    Fyfe, Colin
    International Conference on Knowledge-Based Intelligent Electronic Systems, Proceedings, KES, 2000, 1 : 309 - 312
  • [44] SPARSE FUNCTIONAL PRINCIPAL COMPONENT ANALYSIS IN HIGH DIMENSIONS
    Hu, Xiaoyu
    Yao, Fang
    STATISTICA SINICA, 2022, 32 : 1939 - 1960
  • [45] Solving sparse principal component analysis with global support
    Santanu S. Dey
    Marco Molinaro
    Guanyi Wang
    Mathematical Programming, 2023, 199 : 421 - 459
  • [46] Sparse Principal Component Analysis via Rotation and Truncation
    Hu, Zhenfang
    Pan, Gang
    Wang, Yueming
    Wu, Zhaohui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (04) : 875 - 890
  • [47] Eigenvectors from Eigenvalues Sparse Principal Component Analysis
    Frost, H. Robert
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2022, 31 (02) : 486 - 501
  • [48] Sparse Principal Component Analysis With Preserved Sparsity Pattern
    Seghouane, Abd-Krim
    Shokouhi, Navid
    Koch, Inge
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (07) : 3274 - 3285
  • [49] Exact and Approximation Algorithms for Sparse Principal Component Analysis
    Li, Yongchun
    Xie, Weijun
    INFORMS JOURNAL ON COMPUTING, 2024,
  • [50] SPARSE PRINCIPAL COMPONENT ANALYSIS VIA VARIABLE PROJECTION
    Erichson, N. Benjamin
    Zheng, Peng
    Manohar, Krithika
    Brunton, Steven L.
    Kutz, J. Nathan
    Aravkin, Aleksandr Y.
    SIAM JOURNAL ON APPLIED MATHEMATICS, 2020, 80 (02) : 977 - 1002