Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization

被引:1
|
作者
Zhang, Qixin [1 ]
Deng, Zengde [2 ]
Jian, Xiangru [3 ]
Chen, Zaiyi [2 ]
Hu, Haoyuan [2 ]
Yang, Yu [1 ]
机构
[1] City Univ Hong Kong, Hong Kong, Peoples R China
[2] Cainiao Network, Hangzhou, Peoples R China
[3] Univ Waterloo, Waterloo, ON, Canada
关键词
distributed data mining; online learning; submodular maximization;
D O I
10.1145/3583780.3614817
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Maximizing a monotone submodular function is a fundamental task in data mining, machine learning, economics, and statistics. In this paper, we present two communication-efficient decentralized online algorithms for the monotone continuous DR-submodular maximization problem, both of which reduce the number of perfunction gradient evaluations and per-round communication complexity from T-3/2 to 1. The first one, One-shot Decentralized MetaFrank-Wolfe (Mono-DMFW), achieves a ( 1 - 1/e)-regret bound of O(T-4/5). As far as we know, this is the first one-shot and projectionfree decentralized online algorithm for monotone continuous DRsubmodular maximization. Next, inspired by the non-oblivious boosting function [29], we propose the Decentralized Online Boosting Gradient Ascent (DOBGA) algorithm, which attains a (1- 1/e)-regret of O (root T). To the best of our knowledge, this is the first result to obtain the optimal O (root T) against a ( 1- 1/e)-approximation with only one gradient inquiry for each local objective function per step. Finally, various experimental results confirm the effectiveness of the proposed methods.
引用
收藏
页码:3330 / 3339
页数:10
相关论文
共 50 条
  • [41] Robust communication-efficient decentralized learning with heterogeneity
    Zhang, Xiao
    Wang, Yangyang
    Chen, Shuzhen
    Wang, Cui
    Yu, Dongxiao
    Cheng, Xiuzhen
    JOURNAL OF SYSTEMS ARCHITECTURE, 2023, 141
  • [42] Communication-efficient Decentralized Quickest Change Detection
    Wang, Hongfei
    Blostein, Steven D.
    2014 27TH BIENNIAL SYMPOSIUM ON COMMUNICATIONS (QBSC), 2014, : 47 - 51
  • [43] Communication-efficient algorithms for decentralized and stochastic optimization
    Lan, Guanghui
    Lee, Soomin
    Zhou, Yi
    MATHEMATICAL PROGRAMMING, 2020, 180 (1-2) : 237 - 284
  • [44] One-pass streaming algorithm for DR-submodular maximization with a knapsack constraint over the integer lattice
    Tan, Jingjing
    Zhang, Dongmei
    Zhang, Hongyang
    Zhang, Zhenning
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 99
  • [45] Expander Graph and Communication-Efficient Decentralized Optimization
    Chow, Yat-Tin
    Shi, Wei
    Wu, Tianyu
    Yin, Wotao
    2016 50TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, 2016, : 1715 - 1720
  • [46] A fast and deterministic algorithm for Knapsack-constrained monotone DR-submodular maximization over an integer lattice
    Suning Gong
    Qingqin Nong
    Shuyu Bao
    Qizhi Fang
    Ding-Zhu Du
    Journal of Global Optimization, 2023, 85 : 15 - 38
  • [47] Communication-efficient algorithms for decentralized and stochastic optimization
    Guanghui Lan
    Soomin Lee
    Yi Zhou
    Mathematical Programming, 2020, 180 : 237 - 284
  • [48] Communication-Efficient Design for Quantized Decentralized Federated Learning
    Chen, Li
    Liu, Wei
    Chen, Yunfei
    Wang, Weidong
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2024, 72 : 1175 - 1188
  • [49] DIFFERENTIAL ERROR FEEDBACK FOR COMMUNICATION-EFFICIENT DECENTRALIZED OPTIMIZATION
    Nassif, Roula
    Vlaski, Stefan
    Carpentiero, Marco
    Matta, Vincenzo
    Sayed, Ali H.
    2024 IEEE 13RD SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP, SAM 2024, 2024,
  • [50] COMMUNICATION-EFFICIENT WEIGHTED ADMM FOR DECENTRALIZED NETWORK OPTIMIZATION
    Ling, Qing
    Liu, Yaohua
    Shi, Wei
    Tian, Zhi
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 4821 - 4825