ADD-OPT: Accelerated Distributed Directed Optimization

被引:132
|
作者
Xi, Chenguang [1 ]
Xin, Ran [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Dept Elect & Comp Engn, Medford, MA 02155 USA
关键词
DEXTRA; directed graph; distributed optimization; linear convergence; DECENTRALIZED CONSENSUS OPTIMIZATION; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHM; NETWORKS; DIGRAPHS; GRAPHS; COMMUNICATION; COMPUTATION; SPECTRUM;
D O I
10.1109/TAC.2017.2737582
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multiagent network. We focus on the case when the interagent communication is described by a strongly connected, directed graph. The proposed algorithm, Accelerated Distributed Directed OPTimization (ADD-OPT), achieves the best known convergence rate for this class of problems, O(mu(k)), 0 < mu < 1, given strongly convex, objective functions with globally Lipschitz-continuous gradients, where k is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step sizes. Simulations further illustrate our results.
引用
收藏
页码:1329 / 1339
页数:11
相关论文
共 50 条
  • [1] Accelerated Nesterov Design for Distributed Optimization Over Directed Graphs
    Zhoubin Zhang
    Xiaoqi Yin
    Yuan Fan
    Songsong Cheng
    International Journal of Control, Automation and Systems, 2025, 23 (4) : 1058 - 1068
  • [2] Surplus-based accelerated algorithms for distributed optimization over directed networks
    Wang, Dong
    Wang, Zhu
    Lian, Jie
    Wang, Wei
    Automatica, 2022, 146
  • [3] Surplus-based accelerated algorithms for distributed optimization over directed networks
    Wang, Dong
    Wang, Zhu
    Lian, Jie
    Wang, Wei
    AUTOMATICA, 2022, 146
  • [4] An accelerated exact distributed first-order algorithm for optimization over directed networks
    Wang, Zheng
    Wang, Chengbo
    Wang, Jinmeng
    Hu, Jinhui
    Li, Huaqing
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (14): : 10706 - 10727
  • [5] Accelerated Distributed Optimization over Directed Graphs with Row and Column-Stochastic Matrices
    Hu, Jinhui
    Zhu, Yifan
    Li, Huaqing
    Wang, Zheng
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1299 - 1305
  • [6] Accelerated Distributed Stochastic Nonconvex Optimization Over Time-Varying Directed Networks
    Chen, Yiyue
    Hashemi, Abolfazl
    Vikalo, Haris
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2025, 70 (04) : 2196 - 2211
  • [7] Accelerated Convergence Algorithm for Distributed Constrained Optimization under Time-Varying General Directed Graphs
    Li, Huaqing
    Lu, Qingguo
    Liao, Xiaofeng
    Huang, Tingwen
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (07): : 2612 - 2622
  • [8] On the distributed optimization over directed networks
    Xi, Chenguang
    Wu, Qiong
    Khan, Usman A.
    NEUROCOMPUTING, 2017, 267 : 508 - 515
  • [9] Bilevel Distributed Optimization in Directed Networks
    Yousefian, Farzad
    2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 2230 - 2235
  • [10] A distributed accelerated optimization algorithm over time-varying directed graphs with uncoordinated step-sizes
    Ran, Liang
    Wang, Chengbo
    Zheng, Lifeng
    Li, Huaqing
    Wang, Zheng
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (04): : 1182 - 1200