Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization

被引:1
|
作者
Zhang, Qixin [1 ]
Deng, Zengde [2 ]
Jian, Xiangru [3 ]
Chen, Zaiyi [2 ]
Hu, Haoyuan [2 ]
Yang, Yu [1 ]
机构
[1] City Univ Hong Kong, Hong Kong, Peoples R China
[2] Cainiao Network, Hangzhou, Peoples R China
[3] Univ Waterloo, Waterloo, ON, Canada
关键词
distributed data mining; online learning; submodular maximization;
D O I
10.1145/3583780.3614817
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Maximizing a monotone submodular function is a fundamental task in data mining, machine learning, economics, and statistics. In this paper, we present two communication-efficient decentralized online algorithms for the monotone continuous DR-submodular maximization problem, both of which reduce the number of perfunction gradient evaluations and per-round communication complexity from T-3/2 to 1. The first one, One-shot Decentralized MetaFrank-Wolfe (Mono-DMFW), achieves a ( 1 - 1/e)-regret bound of O(T-4/5). As far as we know, this is the first one-shot and projectionfree decentralized online algorithm for monotone continuous DRsubmodular maximization. Next, inspired by the non-oblivious boosting function [29], we propose the Decentralized Online Boosting Gradient Ascent (DOBGA) algorithm, which attains a (1- 1/e)-regret of O (root T). To the best of our knowledge, this is the first result to obtain the optimal O (root T) against a ( 1- 1/e)-approximation with only one gradient inquiry for each local objective function per step. Finally, various experimental results confirm the effectiveness of the proposed methods.
引用
收藏
页码:3330 / 3339
页数:10
相关论文
共 50 条
  • [31] Multiple knapsack-constrained monotone DR-submodular maximization on distributive lattice - Continuous Greedy Algorithm on Median Complex
    Maehara, Takanori
    Nakashima, So
    Yamaguchi, Yutaro
    MATHEMATICAL PROGRAMMING, 2022, 194 (1-2) : 85 - 119
  • [32] A fast double greedy algorithm for non-monotone DR-submodular function maximization
    Gu, Shuyang
    Shi, Ganquan
    Wu, Weili
    Lu, Changhong
    DISCRETE MATHEMATICS ALGORITHMS AND APPLICATIONS, 2020, 12 (01)
  • [33] A Stochastic Non-monotone DR-Submodular Maximization Problem over a Convex Set
    Lian, Yuefang
    Xu, Dachuan
    Du, Donglei
    Zhou, Yang
    COMPUTING AND COMBINATORICS, COCOON 2022, 2022, 13595 : 1 - 11
  • [34] Online Weakly DR-Submodular Optimization with Stochastic Long-Term Constraints
    Feng, Junkai
    Yang, Ruiqi
    Zhang, Yapu
    Zhang, Zhenning
    THEORY AND APPLICATIONS OF MODELS OF COMPUTATION, TAMC 2022, 2022, 13571 : 32 - 42
  • [35] Algorithms for Cardinality-Constrained Monotone DR-Submodular Maximization with Low Adaptivity and Query Complexity
    Suning Gong
    Qingqin Nong
    Jiazhu Fang
    Ding-Zhu Du
    Journal of Optimization Theory and Applications, 2024, 200 : 194 - 214
  • [36] Communication-Efficient Decentralized Subspace Estimation
    Jiao, Yuchen
    Gu, Yuantao
    IEEE Journal on Selected Topics in Signal Processing, 2022, 16 (03): : 516 - 531
  • [37] Communication-Efficient Decentralized Subspace Estimation
    Jiao, Yuchen
    Gu, Yuantao
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (03) : 516 - 531
  • [38] Algorithms for Cardinality-Constrained Monotone DR-Submodular Maximization with Low Adaptivity and Query Complexity
    Gong, Suning
    Nong, Qingqin
    Fang, Jiazhu
    Du, Ding-Zhu
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 200 (01) : 194 - 214
  • [39] Efficient Streaming Algorithms for Maximizing Monotone DR-Submodular Function on the Integer Lattice
    Nguyen, Bich-Ngan T.
    Pham, Phuong N. H.
    Le, Van-Vang
    Snasel, Vaclav
    MATHEMATICS, 2022, 10 (20)
  • [40] A fast and deterministic algorithm for Knapsack-constrained monotone DR-submodular maximization over an integer lattice
    Gong, Suning
    Nong, Qingqin
    Bao, Shuyu
    Fang, Qizhi
    Du, Ding-Zhu
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 85 (01) : 15 - 38