A reduced proximal-point homotopy method for large-scale non-convex BQP

被引:0
|
作者
Xiubo Liang
Guoqiang Wang
Bo Yu
机构
[1] Dalian University of Technology,School of Mathematical Sciences
[2] Business Research and Development department JD.com,undefined
关键词
Quadratic programming; Box constraints; Non-convex; Proximal point method; Homotopy method;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a reduced proximal-point homotopy (RPP-Hom) method is presented for large-scale non-convex box constrained quadratic programming (BQP) problems. As the outer iteration, at each step, the reduced proximal-point (RPP) algorithm applies the proximal point algorithm to a reduced BQP problem. The variables of the reduced subproblem include all free variables and variables at bound with respect to which the optimality conditions are violated. The RPP subproblem is solved by, as the inner iteration, an efficient piecewise linear homotopy path following method. A special termination criterion for the RPP algorithm is given and the global convergence as well as the locally linear convergence to a Karush-Kuhn-Tucker point is proved. Furthermore, a random perturbation procedure is given to modify RPP such that it converges to a local minimizer with probability 1. An accelerated version of RPP is also presented. Numerical experiments show that the RPP-Hom method outperforms the state-of-the-art algorithms for most of the benchmark problems, especially for training non-convex support vector machine.
引用
收藏
页码:539 / 567
页数:28
相关论文
共 50 条
  • [11] Non-convex feasibility problems and proximal point methods
    Corvellec, JN
    Flåm, SD
    OPTIMIZATION METHODS & SOFTWARE, 2004, 19 (01): : 3 - 14
  • [12] Large-Scale Non-convex Stochastic Constrained Distributionally Robust Optimization
    Zhang, Qi
    Zhou, Yi
    Prater-Bennette, Ashley
    Shen, Lixin
    Zou, Shaofeng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 8217 - 8225
  • [13] Single Loop Gaussian Homotopy Method for Non-convex Optimization
    Iwakiri, Hidenori
    Wang, Yuhang
    Ito, Shinji
    Takeda, Akiko
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [14] PIPA: A NEW PROXIMAL INTERIOR POINT ALGORITHM FOR LARGE-SCALE CONVEX OPTIMIZATION
    Corbineau, Marie-Caroline
    Chouzenoux, Emilie
    Pesquet, Jean-Christophe
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1343 - 1347
  • [15] A new hybrid conjugate gradient method for large-scale unconstrained optimization problem with non-convex objective function
    Zahra Khoshgam
    Ali Ashrafi
    Computational and Applied Mathematics, 2019, 38
  • [16] A new modified scaled conjugate gradient method for large-scale unconstrained optimization with non-convex objective function
    Khoshgam, Zahra
    Ashrafi, Ali
    OPTIMIZATION METHODS & SOFTWARE, 2019, 34 (04): : 783 - 796
  • [17] A new hybrid conjugate gradient method for large-scale unconstrained optimization problem with non-convex objective function
    Khoshgam, Zahra
    Ashrafi, Ali
    COMPUTATIONAL & APPLIED MATHEMATICS, 2019, 38 (04):
  • [18] Non-Convex Large-Scale Scheduling for Energy-Efficient Flexible Stamping Systems
    Pang, Chee Khiang
    Cao Vinh Le
    2013 10TH IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2013, : 1656 - 1661
  • [19] A non-convex optimization framework for large-scale low-rank matrix factorization
    Hafshejani, Sajad Fathi
    Vahidian, Saeed
    Moaberfard, Zahra
    Lin, Bill
    MACHINE LEARNING WITH APPLICATIONS, 2022, 10
  • [20] Stochastic proximal linear method for structured non-convex problems
    Hazan, Tamir
    Sabach, Shoham
    Voldman, Sergey
    OPTIMIZATION METHODS & SOFTWARE, 2020, 35 (05): : 921 - 937