ADD-OPT: Accelerated Distributed Directed Optimization

被引:132
|
作者
Xi, Chenguang [1 ]
Xin, Ran [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Dept Elect & Comp Engn, Medford, MA 02155 USA
关键词
DEXTRA; directed graph; distributed optimization; linear convergence; DECENTRALIZED CONSENSUS OPTIMIZATION; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHM; NETWORKS; DIGRAPHS; GRAPHS; COMMUNICATION; COMPUTATION; SPECTRUM;
D O I
10.1109/TAC.2017.2737582
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multiagent network. We focus on the case when the interagent communication is described by a strongly connected, directed graph. The proposed algorithm, Accelerated Distributed Directed OPTimization (ADD-OPT), achieves the best known convergence rate for this class of problems, O(mu(k)), 0 < mu < 1, given strongly convex, objective functions with globally Lipschitz-continuous gradients, where k is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step sizes. Simulations further illustrate our results.
引用
收藏
页码:1329 / 1339
页数:11
相关论文
共 50 条
  • [41] Accelerated Shift-and-Add algorithms
    Revol, Nathalie
    Yakoubsohn, Jean-Claude
    Reliable Computing, 2000, 6 (02) : 193 - 205
  • [42] A second-order accelerated neurodynamic approach for distributed convex optimization
    Jiang, Xinrui
    Qin, Sitian
    Xue, Xiaoping
    Liu, Xinzhi
    NEURAL NETWORKS, 2022, 146 : 161 - 173
  • [43] A Chebyshev-Accelerated Primal-Dual Method for Distributed Optimization
    Seidman, Jacob H.
    Fazlyab, Mahyar
    Pappas, George J.
    Preciado, Victor M.
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 1775 - 1781
  • [44] Robust Optimization Over Networks Using Distributed Restarting of Accelerated Dynamics
    Ochoa, Daniel E.
    Poveda, Jorge I.
    Uribe, Cesar A.
    Quijano, Nicanor
    IEEE CONTROL SYSTEMS LETTERS, 2021, 5 (01): : 301 - 306
  • [45] Accelerated Distributed Nesterov Optimization Subject to Complex Constraints and Its Applications
    Liu, Bing
    Du, Wenli
    Li, Zhongmei
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (04): : 2055 - 2066
  • [46] An accelerated algorithm for distributed optimization with Barzilai-Borwein step sizes
    Zhang, Xuexue
    Liu, Sanyang
    Zhao, Nannan
    SIGNAL PROCESSING, 2023, 202
  • [47] Accelerated Projection Algorithm Based on Smoothing Approximation for Distributed Nonsmooth Optimization
    Zhao, You
    Liao, Xiaofeng
    He, Xing
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (04): : 1682 - 1694
  • [48] Accelerated Alternating Direction Method of Multipliers Gradient Tracking for Distributed Optimization
    Sebastian, Eduardo
    Franceschelli, Mauro
    Gasparri, Andrea
    Montijano, Eduardo
    Sagus, Carlos
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 640 - 645
  • [49] Distributed Optimization Over Directed Graphs with Continuous-Time Algorithm
    Jia, Wenwen
    Qin, Sitian
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 1911 - 1916
  • [50] Distributed Optimization Control for Heterogeneous Multiagent Systems under Directed Topologies
    Wang, Jingyi
    Liu, Danqi
    Feng, Jianwen
    Zhao, Yi
    MATHEMATICS, 2023, 11 (06)