ADD-OPT: Accelerated Distributed Directed Optimization

被引:132
|
作者
Xi, Chenguang [1 ]
Xin, Ran [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Dept Elect & Comp Engn, Medford, MA 02155 USA
关键词
DEXTRA; directed graph; distributed optimization; linear convergence; DECENTRALIZED CONSENSUS OPTIMIZATION; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHM; NETWORKS; DIGRAPHS; GRAPHS; COMMUNICATION; COMPUTATION; SPECTRUM;
D O I
10.1109/TAC.2017.2737582
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multiagent network. We focus on the case when the interagent communication is described by a strongly connected, directed graph. The proposed algorithm, Accelerated Distributed Directed OPTimization (ADD-OPT), achieves the best known convergence rate for this class of problems, O(mu(k)), 0 < mu < 1, given strongly convex, objective functions with globally Lipschitz-continuous gradients, where k is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step sizes. Simulations further illustrate our results.
引用
收藏
页码:1329 / 1339
页数:11
相关论文
共 50 条
  • [21] Distributed accelerated optimization algorithms:Insights from an ODE
    CHEN RuiJuan
    YANG Tao
    CHAI TianYou
    Science China(Technological Sciences), 2020, (09) : 1647 - 1655
  • [22] An Accelerated Distributed Conditional Gradient Method for Online Optimization
    Shen, Xiuyu
    Li, Dequan
    Dong, Qiao
    Xue, Sheng
    2019 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2019), VOL 2, 2019, : 29 - 32
  • [23] Mills opt for optimization
    1600, (35):
  • [24] A Fast Algorithm for Distributed Optimization over Directed Networks
    Zeng, Jinshan
    He, Tao
    2016 IEEE INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2016, : 45 - 49
  • [25] Double-Like Accelerated Distributed Optimization Algorithm for Convex Optimization Problem
    Zhang, Keke
    Xiong, Jiang
    Dai, Xiangguang
    2020 10TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2020, : 13 - 17
  • [26] Accelerated Distributed Optimization Design for Reconstruction of Big Sensory Data
    Chen, Siguang
    Wang, Kun
    Zhao, Chuanxin
    Zhang, Haijun
    Sun, Yanfei
    IEEE INTERNET OF THINGS JOURNAL, 2017, 4 (05): : 1716 - 1725
  • [27] An Accelerated Gradient Tracking Algorithm with Projection Error for Distributed Optimization
    Meng, Xiwang
    Liu, Qingshan
    Xiong, Jiang
    2023 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE, ICACI, 2023,
  • [28] MUSIC: Accelerated Convergence for Distributed Optimization With Inexact and Exact Methods
    Wu, Mou
    Liao, Haibin
    Ding, Zhengtao
    Xiao, Yonggang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (03) : 4893 - 4907
  • [29] MUSIC: Accelerated Convergence for Distributed Optimization With Inexact and Exact Methods
    Wu, Mou
    Liao, Haibin
    Ding, Zhengtao
    Xiao, Yonggang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [30] An Accelerated Second-Order Method for Distributed Stochastic Optimization
    Agafonov, Artem
    Dvurechensky, Pavel
    Scutari, Gesualdo
    Gasnikov, Alexander
    Kamzolov, Dmitry
    Lukashevich, Aleksandr
    Daneshmand, Amir
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 2407 - 2413