A reduced proximal-point homotopy method for large-scale non-convex BQP

被引:0
|
作者
Xiubo Liang
Guoqiang Wang
Bo Yu
机构
[1] Dalian University of Technology,School of Mathematical Sciences
[2] Business Research and Development department JD.com,undefined
关键词
Quadratic programming; Box constraints; Non-convex; Proximal point method; Homotopy method;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a reduced proximal-point homotopy (RPP-Hom) method is presented for large-scale non-convex box constrained quadratic programming (BQP) problems. As the outer iteration, at each step, the reduced proximal-point (RPP) algorithm applies the proximal point algorithm to a reduced BQP problem. The variables of the reduced subproblem include all free variables and variables at bound with respect to which the optimality conditions are violated. The RPP subproblem is solved by, as the inner iteration, an efficient piecewise linear homotopy path following method. A special termination criterion for the RPP algorithm is given and the global convergence as well as the locally linear convergence to a Karush-Kuhn-Tucker point is proved. Furthermore, a random perturbation procedure is given to modify RPP such that it converges to a local minimizer with probability 1. An accelerated version of RPP is also presented. Numerical experiments show that the RPP-Hom method outperforms the state-of-the-art algorithms for most of the benchmark problems, especially for training non-convex support vector machine.
引用
收藏
页码:539 / 567
页数:28
相关论文
共 50 条
  • [31] Large Scale Image Understanding with Non-convex Multi-task Learning
    Li, Liang
    Yan, Chenggang
    Chen, Xing
    Jiang, Shuqiang
    Rho, Seungmin
    Yin, Jian
    Jiang, Baochen
    Huang, Qingming
    2014 5TH INTERNATIONAL CONFERENCE ON GAME THEORY FOR NETWORKS (GAMENETS), 2014,
  • [32] A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization
    Xin, Ran
    Khan, Usman A.
    Kar, Soummya
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [33] Robust Large-Scale Non-Negative Matrix Factorization Using Proximal Point Algorithm
    Liu, Jason Gejie
    Aeron, Shuchin
    2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 1127 - 1130
  • [34] Non-euclidean restricted memory level method for large-scale convex optimization
    Aharon Ben-Tal
    Arkadi Nemirovski
    Mathematical Programming, 2005, 102 : 407 - 456
  • [35] Non-euclidean restricted memory level method for large-scale convex optimization
    Ben-Tal, A
    Nemirovski, A
    MATHEMATICAL PROGRAMMING, 2005, 102 (03) : 407 - 456
  • [36] Regrets of proximal method of multipliers for online non-convex optimization with long term constraints
    Liwei Zhang
    Haoyang Liu
    Xiantao Xiao
    Journal of Global Optimization, 2023, 85 : 61 - 80
  • [37] Regrets of proximal method of multipliers for online non-convex optimization with long term constraints
    Zhang, Liwei
    Liu, Haoyang
    Xiao, Xiantao
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 85 (01) : 61 - 80
  • [38] Proximal Gradient Method with Extrapolation and Line Search for a Class of Non-convex and Non-smooth Problems
    Lei Yang
    Journal of Optimization Theory and Applications, 2024, 200 : 68 - 103
  • [39] Reduced subgradient bundle method for linearly constrained non-smooth non-convex problems
    El Ghali, A.
    El Moudden, M.
    OPTIMIZATION, 2021, 70 (10) : 2103 - 2130
  • [40] Proximal Gradient Method with Extrapolation and Line Search for a Class of Non-convex and Non-smooth Problems
    Yang, Lei
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 200 (01) : 68 - 103