CUTTING PLANE GENERATION THROUGH SPARSE PRINCIPAL COMPONENT ANALYSIS

被引:2
|
作者
Dey, Santanu S. [1 ]
Kazachkov, Aleksandr [2 ]
Lodi, Andrea [3 ,4 ]
Munoz, Gonzalo [5 ]
机构
[1] Georgia Inst Technol, H Milton Stewart Sch Ind & Syst Engn, Atlanta, GA 30332 USA
[2] Univ Florida, Gainesville, FL 32611 USA
[3] Polytech Montreal, CERC, Montreal, PQ H3C 3A7, Canada
[4] Cornell Tech & Technion IIT, Jacobs Technion Cornell Inst, New York, NY 10044 USA
[5] Univ OHiggins, Rancagua 2940032, Chile
关键词
quadratically constrained quadratic programs; nonconvex optimization; sparse cutting planes; sparse principal component analysis; QUADRATIC-PROGRAMMING PROBLEMS; POWER METHOD; OPTIMIZATION; RELAXATIONS; ALGORITHM; FACETS; CUTS;
D O I
10.1137/21M1399956
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Quadratically constrained quadratic programs (QCQPs) are optimization models whose remarkable expressiveness have made them a cornerstone of methodological research for non convex optimization problems. However, modern methods to solve a general QCQP fail to scale, encountering computational challenges even with just a few hundred variables. Specifically, a semi definite programming (SDP) relaxation is typically employed, which provides strong dual bounds for QCQPs but relies on memory-intensive algorithms. An appealing alternative is to replace the SDP with an easier-to-solve linear programming relaxation while still achieving strong bounds. In this work, we make advances toward achieving this goal by developing a computationally efficient linear cutting plane algorithm that emulates the SDP-based approximations of nonconvex QCQPs. The cutting planes are required to be sparse, in order to ensure a numerically attractive approximation, and efficiently computable. We present a novel connection between such sparse cut generation and the sparse principal component analysis problem in statistics, which allows us to achieve these two goals. We show extensive computational results advocating for the use of our approach.
引用
收藏
页码:1319 / 1343
页数:25
相关论文
共 50 条
  • [1] Craniofacial similarity analysis through sparse principal component analysis
    Zhao, Junli
    Duan, Fuqing
    Pan, Zhenkuan
    Wu, Zhongke
    Li, Jinhua
    Deng, Qingqiong
    Li, Xiaona
    Zhou, Mingquan
    PLOS ONE, 2017, 12 (06):
  • [2] Sparse principal component analysis
    Zou, Hui
    Hastie, Trevor
    Tibshirani, Robert
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2006, 15 (02) : 265 - 286
  • [3] Robust sparse principal component analysis
    ZHAO Qian
    MENG DeYu
    XU ZongBen
    Science China(Information Sciences), 2014, 57 (09) : 175 - 188
  • [4] Multilinear Sparse Principal Component Analysis
    Lai, Zhihui
    Xu, Yong
    Chen, Qingcai
    Yang, Jian
    Zhang, David
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (10) : 1942 - 1950
  • [5] Robust Sparse Principal Component Analysis
    Croux, Christophe
    Filzmoser, Peter
    Fritz, Heinrich
    TECHNOMETRICS, 2013, 55 (02) : 202 - 214
  • [6] Robust sparse principal component analysis
    Zhao Qian
    Meng DeYu
    Xu ZongBen
    SCIENCE CHINA-INFORMATION SCIENCES, 2014, 57 (09) : 1 - 14
  • [7] Weighted sparse principal component analysis
    Van Deun, Katrijn
    Thorrez, Lieven
    Coccia, Margherita
    Hasdemir, Dicle
    Westerhuis, Johan A.
    Smilde, Age K.
    Van Mechelen, Iven
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2019, 195
  • [8] Biobjective sparse principal component analysis
    Carrizosa, Emilio
    Guerrero, Vanesa
    JOURNAL OF MULTIVARIATE ANALYSIS, 2014, 132 : 151 - 159
  • [9] Sparse kernel principal component analysis
    Tipping, ME
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 13, 2001, 13 : 633 - 639
  • [10] Robust sparse principal component analysis
    Qian Zhao
    DeYu Meng
    ZongBen Xu
    Science China Information Sciences, 2014, 57 : 1 - 14