Sequential Difference-of-Convex Programming

被引:7
|
作者
de Oliveira, Welington [1 ]
机构
[1] PSL Res Univ, CMA Ctr Math Appl, MINES ParisTech, Sophia Antipolis, France
关键词
DC programming; Nonsmooth optimization; Variational analysis; NONCONVEX OPTIMIZATION; DC OPTIMIZATION; BUNDLE METHOD; NONSMOOTH; ALGORITHM; NEWTON;
D O I
10.1007/s10957-020-01721-x
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Optimization methods for difference-of-convex programs iteratively solve convex subproblems to define iterates. Although convex, depending on the problem's structure, these subproblems are very often challenging and require specialized solvers. This work investigates a new methodology that defines iterates as approximate critical points of significantly easier difference-of-convex subproblems approximating the original one. Since there is considerable freedom to choose such more accessible subproblems, several algorithms can be designed from the given approach. In some cases, the resulting algorithm boils down to a straightforward process with iterates given in an analytic form. In other situations, decomposable subproblems can be chosen, opening the way for parallel computing even when the original program is not decomposable. Depending on the problem's assumptions, a possible variant of the given approach is the Josephy-Newton method applied to the system of (necessary) optimality conditions of the original difference-of-convex program. In such a setting, local convergence with superlinear and even quadratic rates can be achieved under certain conditions.
引用
收藏
页码:936 / 959
页数:24
相关论文
共 50 条
  • [41] A study of the difference-of-convex approach for solving linear programs with complementarity constraints
    Jara-Moroni, Francisco
    Pang, Jong-Shi
    Wachter, Andreas
    MATHEMATICAL PROGRAMMING, 2018, 169 (01) : 221 - 254
  • [42] A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems
    Liu, Tianxiang
    Pong, Ting Kei
    Takeda, Akiko
    MATHEMATICAL PROGRAMMING, 2019, 176 (1-2) : 339 - 367
  • [43] Value Function Based Difference-of-Convex Algorithm for Bilevel Hyperparameter Selection Problems
    Gao, Lucy
    Ye, Jane J.
    Yin, Haian
    Zeng, Shangzhi
    Zhang, Jin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [44] Regularized linear discriminant analysis via a new difference-of-convex algorithm with extrapolation
    Wang, Chunyan
    Wang, Wenjie
    Li, Mengzhen
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2023, 2023 (01)
  • [45] A difference-of-convex approach for split feasibility with applications to matrix factorizations and outlier detection
    Chen Chen
    Ting Kei Pong
    Lulin Tan
    Liaoyuan Zeng
    Journal of Global Optimization, 2020, 78 : 107 - 136
  • [46] Nonconvex multivariate piecewise-linear fitting using the difference-of-convex representation
    Kazda, Kody
    Li, Xiang
    COMPUTERS & CHEMICAL ENGINEERING, 2021, 150
  • [47] An inexact successive quadratic approximation method for a class of difference-of-convex optimization problems
    Tianxiang Liu
    Akiko Takeda
    Computational Optimization and Applications, 2022, 82 : 141 - 173
  • [48] A difference-of-convex approach for split feasibility with applications to matrix factorizations and outlier detection
    Chen, Chen
    Pong, Ting Kei
    Tan, Lulin
    Zeng, Liaoyuan
    JOURNAL OF GLOBAL OPTIMIZATION, 2020, 78 (01) : 107 - 136
  • [49] Regularized linear discriminant analysis via a new difference-of-convex algorithm with extrapolation
    Chunyan Wang
    Wenjie Wang
    Mengzhen Li
    Journal of Inequalities and Applications, 2023
  • [50] A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems
    Tianxiang Liu
    Ting Kei Pong
    Akiko Takeda
    Mathematical Programming, 2019, 176 : 339 - 367