Mirrored Orthogonal Sampling for Covariance Matrix Adaptation Evolution Strategies

被引:13
|
作者
Wang, Hao [1 ]
Emmerich, Michael [1 ]
Baeck, Thomas [1 ]
机构
[1] Leiden Univ, LIACS, NL-2333 CA Leiden, Netherlands
关键词
Convergence of numerical methods; evolution strategies; mirrored orthogonal sampling;
D O I
10.1162/evco_a_00251
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generating more evenly distributed samples in high dimensional search spaces is the major purpose of the recently proposed mirrored sampling technique for evolution strategies. The diversity of the mutation samples is enlarged and the convergence rate is therefore improved by the mirrored sampling. Motivated by the mirrored sampling technique, this article introduces a new derandomized sampling technique called mirrored orthogonal sampling. The performance of this new technique is both theoretically analyzed and empirically studied on the sphere function. In particular, the mirrored orthogonal sampling technique is applied to the well-known Covariance Matrix Adaptation Evolution Strategy (CMA-ES). The resulting algorithm is experimentally tested on the well-known Black-Box Optimization Benchmark (BBOB). By comparing the results from the benchmark, mirrored orthogonal sampling is found to outperform both the standard CMA-ES and its variant using mirrored sampling.
引用
收藏
页码:699 / 725
页数:27
相关论文
共 50 条
  • [1] Diagonal Acceleration for Covariance Matrix Adaptation Evolution Strategies
    Akimoto, Y.
    Hansen, N.
    EVOLUTIONARY COMPUTATION, 2020, 28 (03) : 405 - 435
  • [2] Dynamic niching in evolution strategies with covariance matrix adaptation
    Shir, OM
    Bäck, T
    2005 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-3, PROCEEDINGS, 2005, : 2584 - 2591
  • [3] Enhancing Mutation Matrix Adaptation Evolution Strategy with Orthogonal Sampling
    Hu, Minghui
    Li, Zhenhua
    Zhang, Hanwen
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14863 : 368 - 380
  • [4] Improving evolution strategies through active covariance matrix adaptation
    Jastrebski, Grahame A.
    Arnold, Dirk V.
    2006 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-6, 2006, : 2799 - +
  • [5] Mirrored Sampling and Sequential Selection for Evolution Strategies
    Brockhoff, Dimo
    Auger, Anne
    Hansen, Nikolaus
    Arnold, Dirk V.
    Hohm, Tim
    PARALLEL PROBLEMS SOLVING FROM NATURE - PPSN XI, PT I, 2010, 6238 : 11 - +
  • [6] Mirrored Sampling in Evolution Strategies With Weighted Recombination
    Auger, Anne
    Brockhoff, Dimo
    Hansen, Nikolaus
    GECCO-2011: PROCEEDINGS OF THE 13TH ANNUAL GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2011, : 861 - 868
  • [7] Tutorial CMA-ES-Evolution Strategies and Covariance Matrix Adaptation
    Auger, Anne
    Hansen, Nikolaus
    PROCEEDINGS OF THE FOURTEENTH INTERNATIONAL CONFERENCE ON GENETIC AND EVOLUTIONARY COMPUTATION COMPANION (GECCO'12), 2012, : 827 - 847
  • [8] Sample Reuse in the Covariance Matrix Adaptation Evolution Strategy Based on Importance Sampling
    Shirakawa, Shinichi
    Akimoto, Youhei
    Ouchi, Kazuki
    Ohara, Kouzou
    GECCO'15: PROCEEDINGS OF THE 2015 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2015, : 305 - 312
  • [9] Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation
    Hansen, M
    Ostermeier, A
    1996 IEEE INTERNATIONAL CONFERENCE ON EVOLUTIONARY COMPUTATION (ICEC '96), PROCEEDINGS OF, 1996, : 312 - 317
  • [10] Contextual Covariance Matrix Adaptation Evolutionary Strategies
    Abdolmaleki, Abbas
    Price, Bob
    Lau, Nuno
    Reis, Luis Paulo
    Neumann, Gerhard
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1378 - 1385