Asynchronous Distributed Optimization Over Lossy Networks via Relaxed ADMM: Stability and Linear Convergence

被引:40
|
作者
Bastianello, Nicola [1 ]
Carli, Ruggero [1 ]
Schenato, Luca [1 ]
Todescato, Marco [2 ]
机构
[1] Univ Padua, Dept Informat Engn DEI, I-35131 Padua, Italy
[2] Bosch Ctr Artificial Intelligence, D-71272 Renningen, Germany
关键词
Convergence; Convex functions; Peer-to-peer computing; Computer architecture; Cost function; Upper bound; Alternating direction method of multipliers (ADMM); asynchronous update; distributed optimization; lossy communications; operator theory; Peaceman– Rachford splitting (PRS); ALTERNATING DIRECTION METHOD; ALGORITHM; CONSENSUS;
D O I
10.1109/TAC.2020.3011358
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we focus on the problem of minimizing the sum of convex cost functions in a distributed fashion over a peer-to-peer network. In particular, we are interested in the case in which communications between nodes are prone to failures, and the agents are not synchronized among themselves. We address the problem proposing a modified version of the relaxed alternating direction method of multipliers, which corresponds to the Peaceman-Rachford splitting method applied to the dual. By exploiting results from operator theory, we are able to prove the almost sure convergence of the proposed algorithm under general assumptions on the distribution of communication loss and node activation events. By further assuming the cost functions to be strongly convex, we prove the linear convergence of the algorithm in mean to a neighborhood of the optimal solution and provide an upper bound to the convergence rate. Finally, we present numerical results testing the proposed method in different scenarios.
引用
收藏
页码:2620 / 2635
页数:16
相关论文
共 50 条
  • [1] Distributed Optimization over Lossy Networks via Relaxed Peaceman-Rachford Splitting: a Robust ADMM Approach
    Bastianello, N.
    Todescato, M.
    Carli, R.
    Schenato, L.
    2018 EUROPEAN CONTROL CONFERENCE (ECC), 2018, : 478 - 483
  • [2] A Partition-Based Implementation of the Relaxed ADMM for Distributed Convex Optimization over Lossy Networks
    Bastianello, N.
    Carli, R.
    Schenato, L.
    Todescato, M.
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 3379 - 3384
  • [3] Fully asynchronous distributed optimization with linear convergence over directed networks
    SHA Xingyu
    ZHANG Jiaqi
    YOU Keyou
    中山大学学报(自然科学版)(中英文), 2023, 62 (05) : 1 - 23
  • [4] Asynchronous Optimization Over Heterogeneous Networks Via Consensus ADMM
    Kumar, Sandeep
    Jain, Rahul
    Rajawat, Ketan
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2017, 3 (01): : 114 - 129
  • [5] Convergence Rate of Distributed ADMM Over Networks
    Makhdoumi, Ali
    Ozdaglar, Asuman
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (10) : 5082 - 5095
  • [6] Asynchronous Distributed Optimization via ADMM with Efficient Communication
    Rikos, Apostolos, I
    Jiang, Wei
    Charalambous, Themistoklis
    Johansson, Karl H.
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 7002 - 7008
  • [7] Analysis of distributed ADMM algorithm for consensus optimisation over lossy networks
    Majzoobi, Layla
    Shah-Mansouri, Vahid
    Lahouti, Farshad
    IET SIGNAL PROCESSING, 2018, 12 (06) : 786 - 794
  • [8] Linear Convergence of ADMM Under Metric Subregularity for Distributed Optimization
    Pan, Xiaowei
    Liu, Zhongxin
    Chen, Zengqiang
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (04) : 2513 - 2520
  • [9] Asynchronous Distributed ADMM for Consensus Optimization
    Zhang, Ruiliang
    Kwok, James T.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 2), 2014, 32 : 1701 - 1709
  • [10] Sublinear and Linear Convergence of Modified ADMM for Distributed Nonconvex Optimization
    Yi, Xinlei
    Zhang, Shengjun
    Yang, Tao
    Chai, Tianyou
    Johansson, Karl Henrik
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (01): : 75 - 86