Analysis of runtime of optimization algorithms for noisy functions over discrete codomains

被引:25
|
作者
Akimoto, Youhei [1 ]
Astete-Morales, Sandra [2 ]
Teytaud, Olivier [2 ]
机构
[1] Shinshu Univ, Inst Engn, Nagano, Japan
[2] Univ Paris Sud, TAO INRIA LRI, F-91405 Orsay, France
关键词
Discrete optimization; Additive noise; Runtime analysis; LOWER BOUNDS; MODEL;
D O I
10.1016/j.tcs.2015.04.008
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider in this work the application of optimization algorithms to problems over discrete codomains corrupted by additive unbiased noise. We propose a modification of the algorithms by repeating the fitness evaluation of the noisy function sufficiently so that, with a fix probability, the function evaluation on the noisy case is identical to the true value. If the runtime of the algorithms on the noise-free case is known, the number of resampling is chosen accordingly. If not, the number of resampling is chosen regarding to the number of fitness evaluations, in an anytime manner. We conclude that if the additive noise is Gaussian, then the runtime on the noisy case, for an adapted algorithm using resamplings, is similar to the runtime on the noise-free case: we incur only an extra logarithmic factor. If the noise is non-Gaussian but with finite variance, then the total runtime of the noisy case is quadratic in function of the runtime on the noise-free case. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:42 / 50
页数:9
相关论文
共 50 条
  • [41] Approximation Algorithms for Discrete Polynomial Optimization
    He S.
    Li Z.
    Zhang S.
    Journal of the Operations Research Society of China, 2013, 1 (1) : 3 - 36
  • [42] Online mixed discrete and continuous optimization: Algorithms, regret analysis and applications
    Ye, Lintao
    Chi, Ming
    Liu, Zhi-Wei
    Wang, Xiaoling
    Gupta, Vijay
    AUTOMATICA, 2025, 175
  • [43] PARALLELIZATION IN LEXICOGRAPHIC DISCRETE OPTIMIZATION ALGORITHMS
    SERGIENKO, IV
    CHERVAK, YY
    GRENDZHA, VI
    CYBERNETICS, 1984, 20 (05): : 720 - 725
  • [44] APPROXIMATION ALGORITHMS FOR DISCRETE OPTIMIZATION PROBLEMS
    LIU, CL
    NOTICES OF THE AMERICAN MATHEMATICAL SOCIETY, 1975, 22 (05): : A597 - A597
  • [45] Distributed Constrained Optimization Over Noisy Networks
    Srivastava, Kunal
    Nedic, Angelia
    Stipanovic, Dusan M.
    49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 1945 - 1950
  • [46] Comparison of the SPSA and simulated annealing algorithms for the constrained optimization of discrete non-separable functions
    Whitney, JE
    Hill, SD
    Wairia, D
    Bahari, F
    PROCEEDINGS OF THE 2003 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2003, : 3260 - 3262
  • [47] Runtime Analysis for Permutation-based Evolutionary Algorithms
    Doerr, Benjamin
    Ghannane, Yassine
    Ibn Brahim, Marouane
    ALGORITHMICA, 2024, 86 (01) : 90 - 129
  • [48] On steepest descent algorithms for discrete convex functions
    Murota, K
    SIAM JOURNAL ON OPTIMIZATION, 2004, 14 (03) : 699 - 707
  • [49] A comparative runtime analysis of heuristic algorithms for satisfiability problems
    Zhou, Yuren
    He, Jun
    Nie, Qing
    ARTIFICIAL INTELLIGENCE, 2009, 173 (02) : 240 - 257
  • [50] Distance distributions and runtime analysis of perceptual hashing algorithms
    Sharma, Shivdutt
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104