A Two-Level Transfer Learning Algorithm for Evolutionary Multitasking

被引:28
|
作者
Ma, Xiaoliang [1 ,2 ,3 ]
Chen, Qunjian [1 ,2 ,3 ]
Yu, Yanan [1 ,2 ,3 ]
Sun, Yiwen [4 ]
Ma, Lijia [1 ,2 ,3 ]
Zhu, Zexuan [1 ,2 ,3 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen, Peoples R China
[2] Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[3] Shenzhen Univ, Natl Engn Lab Big Data Syst Comp Technol, Shenzhen, Peoples R China
[4] Shenzhen Univ, Sch Med, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
evolutionary multitasking; multifactorial optimization; transfer learning; memetic algorithm; knowledge transfer; MOEA/D;
D O I
10.3389/fnins.2019.01408
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Different from conventional single-task optimization, the recently proposed multitasking optimization (MTO) simultaneously deals with multiple optimization tasks with different types of decision variables. MTO explores the underlying similarity and complementarity among the component tasks to improve the optimization process. The well-known multifactorial evolutionary algorithm (MFEA) has been successfully introduced to solve MTO problems based on transfer learning. However, it uses a simple and random inter-task transfer learning strategy, thereby resulting in slow convergence. To deal with this issue, this paper presents a two-level transfer learning (TLTL) algorithm, in which the upper-level implements inter-task transfer learning via chromosome crossover and elite individual learning, and the lower-level introduces intra-task transfer learning based on information transfer of decision variables for an across-dimension optimization. The proposed algorithm fully uses the correlation and similarity among the component tasks to improve the efficiency and effectiveness of MTO. Experimental studies demonstrate the proposed algorithm has outstanding ability of global search and fast convergence rate.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] LEARNING SPARSE TWO-LEVEL BOOLEAN RULES
    Su, Guolong
    Wei, Dennis
    Varshney, Kush R.
    Malioutov, Dmitry M.
    2016 IEEE 26TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2016,
  • [32] Evolutionary Multitasking via Reinforcement Learning
    Li, Shuijia
    Gong, Wenyin
    Wang, Ling
    Gu, Qiong
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (01): : 762 - 775
  • [33] The evolutionary dynamics of selfish replicators: A two-level selection model
    Godelle, B
    Reboud, X
    JOURNAL OF THEORETICAL BIOLOGY, 1997, 185 (03) : 401 - 413
  • [34] Evolutionary Algorithms for the Constrained Two-Level Role Mining Problem
    Anderer, Simon
    Schrader, Falk
    Scheuermann, Bernd
    Mostaghim, Sanaz
    EVOLUTIONARY COMPUTATION IN COMBINATORIAL OPTIMIZATION, EVOCOP 2022, 2022, 13222 : 79 - 94
  • [35] A Two-Level Detection Algorithm for Optical Fiber Vibration
    Bi, Fukun
    Ren, Xuecong
    Qu, Hongquan
    Jiang, Ruiqing
    PHOTONIC SENSORS, 2015, 5 (03) : 284 - 288
  • [36] A Two-Level Genetic Algorithm for Large Optimization Problems
    Pereira, Fabio H.
    Alves, Wonder A. L.
    Koleff, Lucas
    Nabeta, Silvio I.
    IEEE TRANSACTIONS ON MAGNETICS, 2014, 50 (02) : 733 - 736
  • [37] Two-level parallel implementation of FDTD algorithm on CBE
    Li, Bo
    Jin, Hai
    Shao, Zhiyuan
    PROCEEDINGS OF 2008 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL, VOLS 1 AND 2, 2008, : 1812 - 1817
  • [38] Two-level checkpoint algorithm based on dynamic grouping
    Liu G.-L.
    Chen S.-Y.
    Xu G.-X.
    Chang G.-H.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2011, 39 (02): : 141 - 147
  • [39] A two-level distributed algorithm for nonconvex constrained optimization
    Sun, Kaizhao
    Sun, X. Andy
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2023, 84 (02) : 609 - 649
  • [40] A greedy algorithm for the two-level nested logit model
    Li, Guang
    Rusmevichientong, Paat
    OPERATIONS RESEARCH LETTERS, 2014, 42 (05) : 319 - 324