CUTTING PLANE GENERATION THROUGH SPARSE PRINCIPAL COMPONENT ANALYSIS

被引:2
|
作者
Dey, Santanu S. [1 ]
Kazachkov, Aleksandr [2 ]
Lodi, Andrea [3 ,4 ]
Munoz, Gonzalo [5 ]
机构
[1] Georgia Inst Technol, H Milton Stewart Sch Ind & Syst Engn, Atlanta, GA 30332 USA
[2] Univ Florida, Gainesville, FL 32611 USA
[3] Polytech Montreal, CERC, Montreal, PQ H3C 3A7, Canada
[4] Cornell Tech & Technion IIT, Jacobs Technion Cornell Inst, New York, NY 10044 USA
[5] Univ OHiggins, Rancagua 2940032, Chile
关键词
quadratically constrained quadratic programs; nonconvex optimization; sparse cutting planes; sparse principal component analysis; QUADRATIC-PROGRAMMING PROBLEMS; POWER METHOD; OPTIMIZATION; RELAXATIONS; ALGORITHM; FACETS; CUTS;
D O I
10.1137/21M1399956
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Quadratically constrained quadratic programs (QCQPs) are optimization models whose remarkable expressiveness have made them a cornerstone of methodological research for non convex optimization problems. However, modern methods to solve a general QCQP fail to scale, encountering computational challenges even with just a few hundred variables. Specifically, a semi definite programming (SDP) relaxation is typically employed, which provides strong dual bounds for QCQPs but relies on memory-intensive algorithms. An appealing alternative is to replace the SDP with an easier-to-solve linear programming relaxation while still achieving strong bounds. In this work, we make advances toward achieving this goal by developing a computationally efficient linear cutting plane algorithm that emulates the SDP-based approximations of nonconvex QCQPs. The cutting planes are required to be sparse, in order to ensure a numerically attractive approximation, and efficiently computable. We present a novel connection between such sparse cut generation and the sparse principal component analysis problem in statistics, which allows us to achieve these two goals. We show extensive computational results advocating for the use of our approach.
引用
收藏
页码:1319 / 1343
页数:25
相关论文
共 50 条
  • [31] Certifiably optimal sparse principal component analysis
    Lauren Berk
    Dimitris Bertsimas
    Mathematical Programming Computation, 2019, 11 : 381 - 420
  • [32] A Selective Overview of Sparse Principal Component Analysis
    Zou, Hui
    Xue, Lingzhou
    PROCEEDINGS OF THE IEEE, 2018, 106 (08) : 1311 - 1320
  • [33] Sparse multivariate functional principal component analysis
    Song, Jun
    Kim, Kyongwon
    STAT, 2022, 11 (01):
  • [34] ADAPTIVE WEIGHTED SPARSE PRINCIPAL COMPONENT ANALYSIS
    Yi, Shuangyan
    Liang, Yongsheng
    Liu, Wei
    Meng, Fanyang
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,
  • [35] Approximation bounds for sparse principal component analysis
    Alexandre d’Aspremont
    Francis Bach
    Laurent El Ghaoui
    Mathematical Programming, 2014, 148 : 89 - 110
  • [36] A New Basis for Sparse Principal Component Analysis
    Chen, Fan
    Rohe, Karl
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2024, 33 (02) : 421 - 434
  • [37] An exact approach to sparse principal component analysis
    Alessio Farcomeni
    Computational Statistics, 2009, 24 : 583 - 604
  • [38] Certifiably optimal sparse principal component analysis
    Berk, Lauren
    Bertsimasi, Dimitris
    MATHEMATICAL PROGRAMMING COMPUTATION, 2019, 11 (03) : 381 - 420
  • [39] An exact approach to sparse principal component analysis
    Farcomeni, Alessio
    COMPUTATIONAL STATISTICS, 2009, 24 (04) : 583 - 604
  • [40] SPARSE PRINCIPAL COMPONENT ANALYSIS WITH MISSING OBSERVATIONS
    Park, Seyoung
    Zhao, Hongyu
    ANNALS OF APPLIED STATISTICS, 2019, 13 (02): : 1016 - 1042