ZERO-INERTIA LIMIT: FROM PARTICLE SWARM OPTIMIZATION TO CONSENSUS-BASED OPTIMIZATION

被引:9
|
作者
Cipriani, Cristina [1 ]
Huang, Hui [2 ]
Qiu, Jinniao [2 ]
机构
[1] Tech Univ Munich, Dept Math, D-80333 Munich, Germany
[2] Univ Calgary, Dept Math & Stat, Calgary, AB T2N 1N4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
swarm optimization; consensus based optimization; Laplace's principle; tightness; GLOBAL OPTIMIZATION; FIELD; AGGREGATION; CONVERGENCE; DYNAMICS; MODELS;
D O I
10.1137/21M1412323
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Recently a continuous description of particle swarm optimization (PSO) based on a system of stochastic differential equations was proposed by Grassi and Pareschi in [Math. Models Methods Appl. Sci., 31 (2021), pp. 1625--1657] where the authors formally showed the link between PSO and the consensus-based optimization (CBO) through the zero-inertia limit. This paper is devoted to solving this theoretical open problem proposed in [S. Grassi and L. Pareschi, Math. Methods Appl. Sci., 31 (2021), pp. 1625--1657] by providing a rigorous derivation of CBO from PSO through the limit of zero inertia, and a quantified convergence rate is obtained as well. The proofs are based on a probabilistic approach by investigating both the weak and strong convergence of the corresponding stochastic differential equations of Mckean type in the continuous path space and the results are illustrated with some numerical examples.
引用
收藏
页码:3091 / 3121
页数:31
相关论文
共 50 条
  • [31] Review on Inertia Weight Strategies for Particle Swarm Optimization
    Rathore, Ankush
    Sharma, Harish
    PROCEEDINGS OF SIXTH INTERNATIONAL CONFERENCE ON SOFT COMPUTING FOR PROBLEM SOLVING (SOCPROS 2016), VOL 1, 2017, 546 : 73 - 83
  • [32] Experiments and analysis on inertia weight in particle swarm optimization
    Wang, JW
    Wang, DW
    SERVICE SYSTEMS AND SERVICE MANAGEMENT - PROCEEDINGS OF ICSSSM '04, VOLS 1 AND 2, 2004, : 655 - 659
  • [33] COMPARING WITH CHAOTIC INERTIA WEIGHTS IN PARTICLE SWARM OPTIMIZATION
    Feng, Yong
    Yao, Yong-Mei
    Wang, Ai-Xin
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 329 - +
  • [34] Inertia Weight Adaption in Particle Swarm Optimization Algorithm
    Zhou, Zheng
    Shi, Yuhui
    ADVANCES IN SWARM INTELLIGENCE, PT I, 2011, 6728 : 71 - 79
  • [35] The Effect of Usage of Inertia Function in Particle Swarm Optimization
    Nigdeli, Sinan Melih
    Bekdas, Gebrail
    Sayin, Baris
    INTERNATIONAL CONFERENCE OF NUMERICAL ANALYSIS AND APPLIED MATHEMATICS (ICNAAM 2017), 2018, 1978
  • [36] Review on Inertia Weight Strategies for Particle Swarm Optimization
    Rathore, Ankush
    Sharma, Harish
    PROCEEDINGS OF SIXTH INTERNATIONAL CONFERENCE ON SOFT COMPUTING FOR PROBLEM SOLVING, SOCPROS 2016, VOL 2, 2017, 547 : 76 - 86
  • [37] Novel inertia weight strategies for particle swarm optimization
    Chauhan, Pinkey
    Deep, Kusum
    Pant, Millie
    MEMETIC COMPUTING, 2013, 5 (03) : 229 - 251
  • [38] A dynamic inertia weight particle swarm optimization algorithm
    Jiao, Bin
    Lian, Zhigang
    Gu, Xingsheng
    CHAOS SOLITONS & FRACTALS, 2008, 37 (03) : 698 - 705
  • [39] Particle swarm optimization using Gaussian inertia weight
    Pant, Millie
    Radha, T.
    Singh, V. P.
    ICCIMA 2007: INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND MULTIMEDIA APPLICATIONS, VOL I, PROCEEDINGS, 2007, : 97 - 102
  • [40] Particle Swarm Optimization with Ensemble of Inertia Weight Strategies
    Shirazi, Muhammad Zeeshan
    Pamulapati, Trinadh
    Mallipeddi, Rammohan
    Veluvolu, Kalyana Chakravarthy
    ADVANCES IN SWARM INTELLIGENCE, ICSI 2017, PT I, 2017, 10385 : 140 - 147