A reduced proximal-point homotopy method for large-scale non-convex BQP

被引:0
|
作者
Xiubo Liang
Guoqiang Wang
Bo Yu
机构
[1] Dalian University of Technology,School of Mathematical Sciences
[2] Business Research and Development department JD.com,undefined
关键词
Quadratic programming; Box constraints; Non-convex; Proximal point method; Homotopy method;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a reduced proximal-point homotopy (RPP-Hom) method is presented for large-scale non-convex box constrained quadratic programming (BQP) problems. As the outer iteration, at each step, the reduced proximal-point (RPP) algorithm applies the proximal point algorithm to a reduced BQP problem. The variables of the reduced subproblem include all free variables and variables at bound with respect to which the optimality conditions are violated. The RPP subproblem is solved by, as the inner iteration, an efficient piecewise linear homotopy path following method. A special termination criterion for the RPP algorithm is given and the global convergence as well as the locally linear convergence to a Karush-Kuhn-Tucker point is proved. Furthermore, a random perturbation procedure is given to modify RPP such that it converges to a local minimizer with probability 1. An accelerated version of RPP is also presented. Numerical experiments show that the RPP-Hom method outperforms the state-of-the-art algorithms for most of the benchmark problems, especially for training non-convex support vector machine.
引用
收藏
页码:539 / 567
页数:28
相关论文
共 50 条
  • [1] A reduced proximal-point homotopy method for large-scale non-convex BQP
    Liang, Xiubo
    Wang, Guoqiang
    Yu, Bo
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2022, 81 (02) : 539 - 567
  • [2] Complexity of an inexact proximal-point penalty method for constrained smooth non-convex optimization
    Lin, Qihang
    Ma, Runchao
    Xu, Yangyang
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2022, 82 (01) : 175 - 224
  • [3] Complexity of an inexact proximal-point penalty method for constrained smooth non-convex optimization
    Qihang Lin
    Runchao Ma
    Yangyang Xu
    Computational Optimization and Applications, 2022, 82 : 175 - 224
  • [4] Large-scale regression with non-convex loss and penalty
    Buccini, Alessandro
    Cabrera, Omar De la Cruz
    Donatelli, Marco
    Martinelli, Andrea
    Reichel, Lothar
    APPLIED NUMERICAL MATHEMATICS, 2020, 157 : 590 - 601
  • [5] On Stochastic Proximal-Point Method for Convex-Composite Optimization
    Nedic, Angelia
    Tatarenko, Tatiana
    2017 55TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2017, : 198 - 203
  • [6] GLOBAL OPTIMIZATION FOR NON-CONVEX PROGRAMS VIA CONVEX PROXIMAL POINT METHOD
    Zhao, Yuanyi
    Xing, Wenxun
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (06) : 4591 - 4614
  • [7] Stochastic variance reduced gradient with hyper-gradient for non-convex large-scale learning
    Yang, Zhuang
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28627 - 28641
  • [8] Stochastic variance reduced gradient with hyper-gradient for non-convex large-scale learning
    Zhuang Yang
    Applied Intelligence, 2023, 53 : 28627 - 28641
  • [9] Numerical methods for large-scale non-convex quadratic programming
    Gould, NIM
    Toint, PL
    TRENDS IN INDUSTRIAL AND APPLIED MATHEMATICS, PROCEEDINGS, 2002, 72 : 149 - 179
  • [10] Homotopy Method for Non-convex Programming in Unbonded Set
    徐庆
    于波
    Northeastern Mathematical Journal, 2005, (01) : 25 - 31