Dual teacher-student based separation mechanism for open set domain adaptation

被引:7
|
作者
Li, Yiyang
Wang, Shengsheng [1 ]
Wang, Bilin
机构
[1] Jilin Univ, Coll Comp Sci & Technol, 2699 Qianjin St, Changchun 130012, Jilin, Peoples R China
关键词
Open set domain adaption; Dual teacher-student; Sample separation mechanism; Selective adversarial learning; ADVERSARIAL;
D O I
10.1016/j.knosys.2023.110600
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Open set domain adaptation (OSDA) is a more realistic and challenging domain adaptation protocol that assumes that the label spaces of source and target domains are different. Existing OSDA methods lack the ability to identify unknown samples and suffer more from negative transfer. To mitigate the negative transfer, we propose a dual teacher-student based sample separation mechanism to accurately identify and separate known and unknown samples in the target domain. Specifically, in the teacher-student structure (TS), students are insensitive to target unknown samples because they learn only source domain knowledge. Therefore, we exploit this property of students to construct a dual teacher-student structure (DTS), which quantifies the similarity between the target samples and the source domain and improves the accuracy and robustness of the similarity assessment. In addition, we further build a selective adversarial learning model by weighting the target samples with the weights derived from the similarity assessment. This promotes cross-domain alignment of the distribution of target samples with higher weights and the distribution of source samples. Extensive experiments conducted on the benchmark dataset demonstrate the significant advantages of the proposed approach over the extant methods.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Teacher-Student Competition for Unsupervised Domain Adaptation
    Xiao, Ruixin
    Liu, Zhilei
    Wu, Baoyuan
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8291 - 8298
  • [2] ADVERSARIAL TEACHER-STUDENT LEARNING FOR UNSUPERVISED DOMAIN ADAPTATION
    Meng, Zhong
    Li, Jinyu
    Gong, Yifan
    Juang, Biing-Hwang
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 5949 - 5953
  • [3] Sample separation and domain alignment complementary learning mechanism for open set domain adaptation
    Long Sifan
    Wang Shengsheng
    Zhao Xin
    Fu Zihao
    Wang Bilin
    Applied Intelligence, 2023, 53 : 18790 - 18805
  • [4] Sample separation and domain alignment complementary learning mechanism for open set domain adaptation
    Long, Sifan
    Wang, Shengsheng
    Zhao, Xin
    Fu, Zihao
    Wang, Bilin
    APPLIED INTELLIGENCE, 2023, 53 (15) : 18790 - 18805
  • [5] PROGRESSIVE MIXUP AUGMENTED TEACHER-STUDENT LEARNING FOR UNSUPERVISED DOMAIN ADAPTATION
    Zheng, Aotian
    Mei, Jie
    Wallace, Farron
    Rose, Craig
    Hussein, Rania
    Hwang, Jenq-Neng
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3030 - 3034
  • [6] Robust Speech Recognition Using Teacher-Student Learning Domain Adaptation
    Ma, Han
    Zhang, Qiaoling
    Tang, Roubing
    Zhang, Lu
    Jia, Yubo
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (12) : 2112 - 2118
  • [7] Large-Scale Domain Adaptation via Teacher-Student Learning
    Li, Jinyu
    Seltzer, Michael L.
    Wang, Xi
    Zhao, Rui
    Gong, Yifan
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 2386 - 2390
  • [8] Interpersonal adaptation in teacher-student interaction
    Pennings, Helena J. M.
    Brekelmans, Mieke
    Sadler, Pamela
    Claessens, Luce C. A.
    van der Want, Anna C.
    van Tartwijk, Jan
    LEARNING AND INSTRUCTION, 2018, 55 : 41 - 57
  • [9] Versatile Teacher: A class-aware teacher-student framework for cross-domain adaptation
    Yang, Runou
    Tian, Tian
    Tian, Jinwen
    PATTERN RECOGNITION, 2025, 158
  • [10] DOMAIN ADAPTATION VIA TEACHER-STUDENT LEARNING FOR END-TO-END SPEECH RECOGNITION
    Meng, Zhong
    Li, Jinyu
    Gaur, Yashesh
    Gong, Yifan
    2019 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU 2019), 2019, : 268 - 275