Analysis of runtime of optimization algorithms for noisy functions over discrete codomains

被引:25
|
作者
Akimoto, Youhei [1 ]
Astete-Morales, Sandra [2 ]
Teytaud, Olivier [2 ]
机构
[1] Shinshu Univ, Inst Engn, Nagano, Japan
[2] Univ Paris Sud, TAO INRIA LRI, F-91405 Orsay, France
关键词
Discrete optimization; Additive noise; Runtime analysis; LOWER BOUNDS; MODEL;
D O I
10.1016/j.tcs.2015.04.008
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider in this work the application of optimization algorithms to problems over discrete codomains corrupted by additive unbiased noise. We propose a modification of the algorithms by repeating the fitness evaluation of the noisy function sufficiently so that, with a fix probability, the function evaluation on the noisy case is identical to the true value. If the runtime of the algorithms on the noise-free case is known, the number of resampling is chosen accordingly. If not, the number of resampling is chosen regarding to the number of fitness evaluations, in an anytime manner. We conclude that if the additive noise is Gaussian, then the runtime on the noisy case, for an adapted algorithm using resamplings, is similar to the runtime on the noise-free case: we incur only an extra logarithmic factor. If the noise is non-Gaussian but with finite variance, then the total runtime of the noisy case is quadratic in function of the runtime on the noise-free case. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:42 / 50
页数:9
相关论文
共 50 条
  • [21] Noisy evolutionary optimization algorithms - A comprehensive survey
    Rakshit, Pratyusha
    Konar, Amit
    Das, Swagatam
    SWARM AND EVOLUTIONARY COMPUTATION, 2017, 33 : 18 - 45
  • [22] Ant algorithms for discrete optimization
    Dorigo, M
    Di Caro, G
    Gambardella, LM
    ARTIFICIAL LIFE, 1999, 5 (02) : 137 - 172
  • [23] Statistical Models for the Analysis of Optimization Algorithms With Benchmark Functions
    Mattos, David Issa
    Bosch, Jan
    Olsson, Helena Holmstrom
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2021, 25 (06) : 1163 - 1177
  • [24] Limitations of optimization algorithms on noisy quantum devices
    Daniel Stilck França
    Raul García-Patrón
    Nature Physics, 2021, 17 : 1221 - 1227
  • [25] ALGORITHMS AND DISCRETE OPTIMIZATION - FOREWORD
    PADBERG, M
    RINALDI, G
    SASSANO, A
    MATHEMATICAL PROGRAMMING, 1989, 45 (02) : R3 - R4
  • [26] Precise Runtime Analysis for Plateau Functions
    Antipov D.
    Doerr B.
    ACM Transactions on Evolutionary Learning and Optimization, 2021, 1 (04):
  • [27] Two simulated annealing algorithms for noisy objective functions
    Prudius, AA
    Andradóttir, S
    PROCEEDINGS OF THE 2005 WINTER SIMULATION CONFERENCE, VOLS 1-4, 2005, : 797 - 802
  • [28] Convergence of successive linear programming algorithms for noisy functions
    Christoph Hansknecht
    Christian Kirches
    Paul Manns
    Computational Optimization and Applications, 2024, 88 : 567 - 601
  • [29] Convergence of successive linear programming algorithms for noisy functions
    Hansknecht, Christoph
    Kirches, Christian
    Manns, Paul
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2024, 88 (02) : 567 - 601
  • [30] Simplified Runtime Analysis of Estimation of Distribution Algorithms
    Duc-Cuong Dang
    Lehre, Per Kristian
    GECCO'15: PROCEEDINGS OF THE 2015 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2015, : 513 - 518