Upper and Lower Bounds for Randomized Search Heuristics in Black-Box Optimization

被引:0
|
作者
Stefan Droste
Thomas Jansen
Ingo Wegener
机构
[1] FB Informatik,
[2] LS2,undefined
[3] University of Dortmund,undefined
[4] 44221 Dortmund,undefined
来源
关键词
Problem Instance; Query Point; Search Point; Unimodal Function; Randomize Search Heuristic;
D O I
暂无
中图分类号
学科分类号
摘要
Randomized search heuristics like local search, tabu search, simulated annealing, or all kinds of evolutionary algorithms have many applications. However, for most problems the best worst-case expected run times are achieved by more problem-specific algorithms. This raises the question about the limits of general randomized search heuristics. Here a framework called black-box optimization is developed. The essential issue is that the problem but not the problem instance is knownto the algorithm which can collect information about the instance only by asking for the value of points in the search space. All known randomized search heuristics fit into this scenario. Lower bounds on the black-box complexity of problems are derived without complexity theoretical assumptions and are compared with upper bounds in this scenario.
引用
收藏
页码:525 / 544
页数:19
相关论文
共 50 条
  • [21] Black-box Optimization with a Politician
    Bubeck, Sebastien
    Lee, Yin-Tat
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [22] Black-Box Search by Unbiased Variation
    Lehre, Per Kristian
    Witt, Carsten
    ALGORITHMICA, 2012, 64 (04) : 623 - 642
  • [23] Bounds on the efficiency of "black-box" commitment schemes
    Horvitz, O
    Katz, J
    AUTOMATA, LANGUAGES AND PROGRAMMING, PROCEEDINGS, 2005, 3580 : 128 - 139
  • [24] Black-Box Search by Unbiased Variation
    Per Kristian Lehre
    Carsten Witt
    Algorithmica, 2012, 64 : 623 - 642
  • [25] Bounds on the efficiency of black-box commitment schemes
    Horvitz, Omer
    Katz, Jonathan
    THEORETICAL COMPUTER SCIENCE, 2010, 411 (10) : 1251 - 1260
  • [26] Parallel Black-Box Complexity With Tail Bounds
    Lehre, Per Kristian
    Sudholt, Dirk
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (06) : 1010 - 1024
  • [27] Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
    Hernandez-Lobato, Jose Miguel
    Hoffman, Matthew W.
    Ghahramani, Zoubin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [28] Robust Black-Box Optimization for Stochastic Search and Episodic Reinforcement Learning
    Huttenrauch, Maximilian
    Neumann, Gerhard
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25 : 1 - 44
  • [29] Probabilistic Permutation Graph Search: Black-Box Optimization for Fairness in Ranking
    Vardasbi, Ali
    Sarvi, Fatemeh
    de Rijke, Maarten
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 715 - 725
  • [30] DiBB: Distributing Black-Box Optimization
    Cuccu, Giuseppe
    Rolshoven, Luca
    Vorpe, Fabien
    Cudre-Mauroux, Philippe
    Glasmachers, Tobias
    PROCEEDINGS OF THE 2022 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'22), 2022, : 341 - 349