ZERO-INERTIA LIMIT: FROM PARTICLE SWARM OPTIMIZATION TO CONSENSUS-BASED OPTIMIZATION

被引:9
|
作者
Cipriani, Cristina [1 ]
Huang, Hui [2 ]
Qiu, Jinniao [2 ]
机构
[1] Tech Univ Munich, Dept Math, D-80333 Munich, Germany
[2] Univ Calgary, Dept Math & Stat, Calgary, AB T2N 1N4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
swarm optimization; consensus based optimization; Laplace's principle; tightness; GLOBAL OPTIMIZATION; FIELD; AGGREGATION; CONVERGENCE; DYNAMICS; MODELS;
D O I
10.1137/21M1412323
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Recently a continuous description of particle swarm optimization (PSO) based on a system of stochastic differential equations was proposed by Grassi and Pareschi in [Math. Models Methods Appl. Sci., 31 (2021), pp. 1625--1657] where the authors formally showed the link between PSO and the consensus-based optimization (CBO) through the zero-inertia limit. This paper is devoted to solving this theoretical open problem proposed in [S. Grassi and L. Pareschi, Math. Methods Appl. Sci., 31 (2021), pp. 1625--1657] by providing a rigorous derivation of CBO from PSO through the limit of zero inertia, and a quantified convergence rate is obtained as well. The proofs are based on a probabilistic approach by investigating both the weak and strong convergence of the corresponding stochastic differential equations of Mckean type in the continuous path space and the results are illustrated with some numerical examples.
引用
收藏
页码:3091 / 3121
页数:31
相关论文
共 50 条
  • [1] From particle swarm optimization to consensus based optimization: Stochastic modeling and mean-field limit
    Grassi, Sara
    Pareschi, Lorenzo
    MATHEMATICAL MODELS & METHODS IN APPLIED SCIENCES, 2021, 31 (08): : 1625 - 1657
  • [2] Consensus-Based Distributed Particle Swarm Optimization with Event-Triggered Communication
    Ishikawa, Kazuyuki
    Hayashi, Naoki
    Takai, Shigemasa
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2018, E101A (02) : 338 - 344
  • [3] On the mean-field limit for the consensus-based optimization
    Huang, Hui
    Qiu, Jinniao
    MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2022, 45 (12) : 7814 - 7831
  • [4] Consensus Clustering Based on Particle Swarm Optimization Algorithm
    Esmin, Ahmed. A. A.
    Coelho, Rodrigo A.
    2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 2280 - 2285
  • [5] A Chaos Particle Swarm Optimization based on Adaptive Inertia Weight
    Jie, Zheng
    ADVANCED MATERIALS AND COMPUTER SCIENCE, PTS 1-3, 2011, 474-476 : 1458 - 1463
  • [6] CONSTRAINED CONSENSUS-BASED OPTIMIZATION
    Borghi, Giacomo
    Herty, Michael
    Pareschi, Lorenzo
    SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (01) : 211 - 236
  • [7] Uniform design and inertia mutation based particle swarm optimization
    Zhang, Boquan
    Yang, Yimin
    Wang, Jianbin
    MIPPR 2007: MEDICAL IMAGING, PARALLEL PROCESSING OF IMAGES, AND OPTIMIZATION TECHNIQUES, 2007, 6789
  • [8] Particle Swarm Optimization with Probabilistic Inertia Weight
    Agrawal, Ankit
    Tripathi, Sarsij
    HARMONY SEARCH AND NATURE INSPIRED OPTIMIZATION ALGORITHMS, 2019, 741 : 239 - 248
  • [9] Adaptive inertia weight particle swarm optimization
    Qin, Zheng
    Yu, Fan
    Shi, Zhewen
    Wang, Yu
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING - ICAISC 2006, PROCEEDINGS, 2006, 4029 : 450 - 459
  • [10] Exponential Inertia Weight for Particle Swarm Optimization
    Ting, T. O.
    Shi, Yuhui
    Cheng, Shi
    Lee, Sanghyuk
    ADVANCES IN SWARM INTELLIGENCE, ICSI 2012, PT I, 2012, 7331 : 83 - 90