Domain Adaptation Multitask Optimization

被引:19
|
作者
Wang, Xiaoling [1 ]
Kang, Qi [1 ]
Zhou, MengChu [2 ,3 ]
Yao, Siya [1 ]
Abusorrah, Abdullah [4 ,5 ]
机构
[1] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Jeddah 21589, Saudi Arabia
[4] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] King Abdulaziz Univ, KA CARE Energy Res & Innovat Ctr, Jeddah 21589, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Domain adaptation; evolutionary algorithm (EA); knowledge transfer; machine learning; multitask optimization (MTO); DIFFERENTIAL EVOLUTION; ALGORITHM;
D O I
10.1109/TCYB.2022.3222101
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multitask optimization (MTO) is a new optimization paradigm that leverages useful information contained in multiple tasks to help solve each other. It attracts increasing attention in recent years and gains significant performance improvements. However, the solutions of distinct tasks usually obey different distributions. To avoid that individuals after intertask learning are not suitable for the original task due to the distribution differences and even impede overall solution efficiency, we propose a novel multitask evolutionary framework that enables knowledge aggregation and online learning among distinct tasks to solve MTO problems. Our proposal designs a domain adaptation-based mapping strategy to reduce the difference across solution domains and find more genetic traits to improve the effectiveness of information interactions. To further improve the algorithm performance, we propose a smart way to divide initial population into different subpopulations and choose suitable individuals to learn. By ranking individuals in target subpopulation, worse-performing individuals can learn from other tasks. The significant advantage of our proposed paradigm over the state of the art is verified via a series of MTO benchmark studies.
引用
收藏
页码:4567 / 4578
页数:12
相关论文
共 50 条
  • [21] Joint Optimization of Feature Transform and Instance Weighting for Domain Adaptation
    Ishii, Masato
    Sato, Atsushi
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 3793 - 3799
  • [22] FAMO: Fast Adaptive Multitask Optimization
    Liu, Bo
    Feng, Yihao
    Stone, Peter
    Liu, Qiang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [23] Multitask-Guided Deep Clustering With Boundary Adaptation
    Zhang, Xiaobo
    Wang, Tao
    Zhao, Xiaole
    Wen, Dengmin
    Zhai, Donghai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 6089 - 6102
  • [24] Multitask diffusion adaptation over hyper-networks
    Bahraini, Tahereh
    Shamsollahi, Mohammad B.
    Afkhaminia, Fatemeh
    DIGITAL SIGNAL PROCESSING, 2025, 158
  • [25] ADAPTIVE REGULARIZED DIFFUSION ADAPTATION OVER MULTITASK NETWORKS
    Monajemi, Sadaf
    Sanei, Saeid
    Ong, Sim-Heng
    Sayed, Ali H.
    2015 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2015,
  • [26] Robust nonlinear adaptation algorithms for multitask prediction networks
    Abuduweili, Abulikemu
    Liu, Changliu
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2021, 35 (03) : 314 - 341
  • [27] AN ANT COLONY OPTIMIZATION BASED INTER DOMAIN CLUSTER MAPPING FOR DOMAIN ADAPTATION IN REMOTE SENSING
    Sharma, Shakti
    Buddhiraju, Krishna Mohan
    Banerjee, Biplab
    2014 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2014, : 2158 - 2161
  • [28] Constrained multitasking optimization via co-evolution and domain adaptation
    Zhang, Tingyu
    Li, Dongcheng
    Li, Yanchi
    Gong, Wenyin
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 87
  • [29] Buffer optimization in multitask implementations of simulink models
    Di Natale, Marco
    Pappalardo, Valerio
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2008, 7 (03)
  • [30] A Review on Evolutionary Multitask Optimization: Trends and Challenges
    Wei, Tingyang
    Wang, Shibin
    Zhong, Jinghui
    Liu, Dong
    Zhang, Jun
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2022, 26 (05) : 941 - 960