Domain Adaptation Multitask Optimization

被引:19
|
作者
Wang, Xiaoling [1 ]
Kang, Qi [1 ]
Zhou, MengChu [2 ,3 ]
Yao, Siya [1 ]
Abusorrah, Abdullah [4 ,5 ]
机构
[1] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Jeddah 21589, Saudi Arabia
[4] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] King Abdulaziz Univ, KA CARE Energy Res & Innovat Ctr, Jeddah 21589, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Domain adaptation; evolutionary algorithm (EA); knowledge transfer; machine learning; multitask optimization (MTO); DIFFERENTIAL EVOLUTION; ALGORITHM;
D O I
10.1109/TCYB.2022.3222101
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multitask optimization (MTO) is a new optimization paradigm that leverages useful information contained in multiple tasks to help solve each other. It attracts increasing attention in recent years and gains significant performance improvements. However, the solutions of distinct tasks usually obey different distributions. To avoid that individuals after intertask learning are not suitable for the original task due to the distribution differences and even impede overall solution efficiency, we propose a novel multitask evolutionary framework that enables knowledge aggregation and online learning among distinct tasks to solve MTO problems. Our proposal designs a domain adaptation-based mapping strategy to reduce the difference across solution domains and find more genetic traits to improve the effectiveness of information interactions. To further improve the algorithm performance, we propose a smart way to divide initial population into different subpopulations and choose suitable individuals to learn. By ranking individuals in target subpopulation, worse-performing individuals can learn from other tasks. The significant advantage of our proposed paradigm over the state of the art is verified via a series of MTO benchmark studies.
引用
收藏
页码:4567 / 4578
页数:12
相关论文
共 50 条
  • [1] Multitask Particle Swarm Optimization With Heterogeneous Domain Adaptation
    Han, Honggui
    Bai, Xing
    Hou, Ying
    Qiao, Junfei
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2024, 28 (01) : 178 - 192
  • [2] Adversarial Multitask Learning for Domain Adaptation Through Domain Adapter
    Hidayaturrahman
    Trisetyarso, Agung
    Kartowisastro, Iman Herwidiana
    Budiharto, Widodo
    IEEE ACCESS, 2024, 12 : 184989 - 184999
  • [3] Multiobjective Multitask Optimization With Multiple Knowledge Types and Transfer Adaptation
    Li, Yanchi
    Gong, Wenyin
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2025, 29 (01) : 205 - 216
  • [4] Multitask Adaptation for Unlabeled Domain Using Multiple Single-Task Domains
    Kang, Youngwook
    Jeong, Hawook
    Shin, Junsup
    Choi, Jongwon
    IEEE ACCESS, 2024, 12 : 194646 - 194656
  • [5] Multipopulation Optimization for Multitask Optimization
    Tang, Zedong
    Gong, Maoguo
    Jiang, Fenlong
    Li, Hao
    Wu, Yue
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 1906 - 1913
  • [6] EBB: PROGRESSIVE OPTIMIZATION FOR PARTIAL DOMAIN ADAPTATION
    Feng, Cheng
    Zhong, Chaoliang
    Wang, Jie
    Sun, Jun
    Yokota, Yasuto
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 734 - 738
  • [7] Divergence Optimization for Noisy Universal Domain Adaptation
    Yu, Qing
    Hashimoto, Atsushi
    Ushiku, Yoshitaka
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2515 - 2524
  • [8] Adversarial Entropy Optimization for Unsupervised Domain Adaptation
    Ma, Ao
    Li, Jingjing
    Lu, Ke
    Zhu, Lei
    Shen, Heng Tao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6263 - 6274
  • [9] Multitask Diffusion Adaptation Over Networks
    Chen, Jie
    Richard, Cedric
    Sayed, Ali H.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (16) : 4129 - 4144
  • [10] DASRSNet: Multitask Domain Adaptation for Super-Resolution-Aided Semantic Segmentation of Remote Sensing Images
    Cai, Yuxiang
    Yang, Yingchun
    Shang, Yongheng
    Shen, Zhengwei
    Yin, Jianwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61