Optimal algorithms for continuous non-monotone submodular and DR-submodular maximization

被引:0
|
作者
Niazadeh, Rad [1 ]
Roughgarden, Tim [2 ]
Wang, Joshua R. [3 ]
机构
[1] Chicago Booth School of Business, University of Chicago, 5807 S Woodlawn Ave, Chicago,IL,60637, United States
[2] Department of Computer Science, Columbia University, 500 West 120th Street, Room 450, New York,NY,10027, United States
[3] Google Research, 1600 Amphitheatre Pkwy, Mountain View,CA,94043, United States
来源
关键词
Game theory - Machine learning;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper we study the fundamental problems of maximizing a continuous nonmonotone submodular function over the hypercube, both with and without coordinate-wise concavity. This family of optimization problems has several applications in machine learning, economics, and communication systems. Our main result is the first 1/2-approximation algorithm for continuous submodular function maximization; this approximation factor of 1/2 is the best possible for algorithms that only query the objective function at polynomially many points. For the special case of DR-submodular maximization, i.e. when the submodular function is also coordinate-wise concave along all coordinates, we provide a different 1/2 -approximation algorithm that runs in quasi-linear time. Both these results improve upon prior work (Bian et al., 2017a, b; Soma and Yoshida, 2017). Our first algorithm uses novel ideas such as reducing the guaranteed approximation problem to analyzing a zero-sum game for each coordinate, and incorporates the geometry of this zero-sum game to fix the value at this coordinate. Our second algorithm exploits coordinate-wise concavity to identify a monotone equilibrium condition sufficient for getting the required approximation guarantee, and hunts for the equilibrium point using binary search. We further run experiments to verify the performance of our proposed algorithms in related machine learning applications. © 2020 Rad Niazadeh, Tim Roughgarden, Joshua R. Wang.
引用
收藏
相关论文
共 50 条
  • [31] Practical and Parallelizable Algorithms for Non-Monotone Submodular Maximization with Size Constraint
    Chen, Yixin
    Kuhnle, Alan
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2022, 79 : 599 - 637
  • [32] Non-monotone Submodular Maximization with Nearly Optimal Adaptivity and Query Complexity
    Fahrbach, Matthew
    Mirrokni, Vahab
    Zadimoghaddam, Morteza
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [33] Optimal Continuous DR-Submodular Maximization and Applications to Provable Mean Field Inference
    Bian, Yatao A.
    Buhmann, Joachim M.
    Krause, Andreas
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [34] Algorithms for Cardinality-Constrained Monotone DR-Submodular Maximization with Low Adaptivity and Query Complexity
    Suning Gong
    Qingqin Nong
    Jiazhu Fang
    Ding-Zhu Du
    Journal of Optimization Theory and Applications, 2024, 200 : 194 - 214
  • [35] Non-monotone Submodular Maximization in Exponentially Fewer Iterations
    Balkanski, Eric
    Breuer, Adam
    Singer, Yaron
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [36] Guarantees of Stochastic Greedy Algorithms for Non-monotone Submodular Maximization with Cardinality Constraint
    Sakaue, Shinsaku
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108
  • [37] Nearly Linear-Time, Parallelizable Algorithms for Non-Monotone Submodular Maximization
    Kuhnle, Alan
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 8200 - 8208
  • [38] Algorithms for Cardinality-Constrained Monotone DR-Submodular Maximization with Low Adaptivity and Query Complexity
    Gong, Suning
    Nong, Qingqin
    Fang, Jiazhu
    Du, Ding-Zhu
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 200 (01) : 194 - 214
  • [39] Constrained Submodular Maximization via New Bounds for DR-Submodular Functions
    Buchbinder, Niv
    Feldman, Moran
    PROCEEDINGS OF THE 56TH ANNUAL ACM SYMPOSIUM ON THEORY OF COMPUTING, STOC 2024, 2024, : 1820 - 1831
  • [40] Stochastic Variance Reduction for DR-Submodular Maximization
    Lian, Yuefang
    Du, Donglei
    Wang, Xiao
    Xu, Dachuan
    Zhou, Yang
    ALGORITHMICA, 2024, 86 (05) : 1335 - 1364