Block-Coordinate Primal-Dual Method for Nonsmooth Minimization over Linear Constraints

被引:4
|
作者
Luke, D. Russell [1 ]
Malitsky, Yura [1 ]
机构
[1] Univ Gottingen, Inst Numer & Appl Math, Gottingen, Germany
来源
关键词
Saddle-point problems; First order algorithms; Primal-dual algorithms; Coordinate methods; Randomized methods; CONVERGENCE ANALYSIS; DECOMPOSITION; OPTIMIZATION; ALGORITHM; NONCONVEX;
D O I
10.1007/978-3-319-97478-1_6
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We consider the problem of minimizing a convex, separable, nonsmooth function subject to linear constraints. The numerical method we propose is a block-coordinate extension of the Chambolle-Pock primal-dual algorithm. We prove convergence of the method without resorting to assumptions like smoothness or strong convexity of the objective, full-rank condition on the matrix, strong duality or even consistency of the linear system. Freedom from imposing the latter assumption permits convergence guarantees for misspecified or noisy systems.
引用
收藏
页码:121 / 147
页数:27
相关论文
共 50 条
  • [31] DSCOVR: Randomized primal-dual block coordinate algorithms for asynchronous distributed optimization
    Xiao, Lin
    Yu, Adams Wei
    Lin, Qihang
    Chen, Weizhu
    Journal of Machine Learning Research, 2019, 20
  • [32] Accelerated dual-averaging primal-dual method for composite convex minimization
    Tan, Conghui
    Qian, Yuqiu
    Ma, Shiqian
    Zhang, Tong
    OPTIMIZATION METHODS & SOFTWARE, 2020, 35 (04): : 741 - 766
  • [33] Distributed Primal-Dual Method for Convex Optimization With Coupled Constraints
    Su, Yanxu
    Wang, Qingling
    Sun, Changyin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 : 523 - 535
  • [34] Random extrapolation for primal-dual coordinate descent
    Alacaoglu, Ahmet
    Fercoq, Olivier
    Cevher, Volkan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [35] A primal-dual potential reduction method for integral quadratic constraints
    Hansson, A
    Vandenberghe, L
    PROCEEDINGS OF THE 2001 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2001, : 3013 - 3018
  • [36] Distributed Primal-Dual Proximal Method for Regularized Empirical Risk Minimization
    Khuzani, Masoud Badiei
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 938 - 945
  • [37] An application of a block iterative method on the primal-dual interior point method
    Saeki, O
    Tsuji, K
    Yoshida, E
    LARGE SCALE SYSTEMS: THEORY AND APPLICATIONS 1998 (LSS'98), VOL 1, 1999, : 501 - 506
  • [38] A Decentralized Primal-Dual Method for Constrained Minimization of a Strongly Convex Function
    Hamedani, Erfan Yazdandoost
    Aybat, Necdet Serhat
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (11) : 5682 - 5697
  • [39] Primal, dual and primal-dual partitions in continuous linear optimization
    Goberna, M. A.
    Todorov, M. I.
    OPTIMIZATION, 2007, 56 (5-6) : 617 - 628
  • [40] A prediction-correction primal-dual hybrid gradient method for convex programming with linear constraints
    Bing, Pibin
    Sui, Jialei
    Sun, Min
    SCIENCEASIA, 2018, 44 (01): : 34 - 39