Dual teacher-student based separation mechanism for open set domain adaptation

被引:7
|
作者
Li, Yiyang
Wang, Shengsheng [1 ]
Wang, Bilin
机构
[1] Jilin Univ, Coll Comp Sci & Technol, 2699 Qianjin St, Changchun 130012, Jilin, Peoples R China
关键词
Open set domain adaption; Dual teacher-student; Sample separation mechanism; Selective adversarial learning; ADVERSARIAL;
D O I
10.1016/j.knosys.2023.110600
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Open set domain adaptation (OSDA) is a more realistic and challenging domain adaptation protocol that assumes that the label spaces of source and target domains are different. Existing OSDA methods lack the ability to identify unknown samples and suffer more from negative transfer. To mitigate the negative transfer, we propose a dual teacher-student based sample separation mechanism to accurately identify and separate known and unknown samples in the target domain. Specifically, in the teacher-student structure (TS), students are insensitive to target unknown samples because they learn only source domain knowledge. Therefore, we exploit this property of students to construct a dual teacher-student structure (DTS), which quantifies the similarity between the target samples and the source domain and improves the accuracy and robustness of the similarity assessment. In addition, we further build a selective adversarial learning model by weighting the target samples with the weights derived from the similarity assessment. This promotes cross-domain alignment of the distribution of target samples with higher weights and the distribution of source samples. Extensive experiments conducted on the benchmark dataset demonstrate the significant advantages of the proposed approach over the extant methods.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] The Synergy Mechanism of Online-Offline Mixed Teaching Based on Teacher-Student Relationship
    Cao, Chang
    INTERNATIONAL JOURNAL OF EMERGING TECHNOLOGIES IN LEARNING, 2022, 17 (10) : 16 - 31
  • [32] Masked Retraining Teacher-Student Framework for Domain Adaptive Object Detection
    Zhao, Zijing
    Wei, Sitong
    Chen, Qingchao
    Li, Dehui
    Yang, Yifan
    Peng, Yuxin
    Liu, Yang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18993 - 19003
  • [33] Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separation
    Zhang, Jisi
    Zorila, Catalin
    Doddipatla, Rama
    Barker, Jon
    INTERSPEECH 2021, 2021, : 3495 - 3499
  • [34] Weighted domain separation based open set fault diagnosis
    Zhang, Xingwu
    Zhao, Yu
    Yu, Xiaolei
    Ma, Rui
    Wang, Chenxi
    Chen, Xuefeng
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 239
  • [35] Smartphone based Teacher-Student Interaction Enhancement System
    Bin Sajjad, Saad
    Imteaj, Ahmed
    2015 INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION ENGINEERING (ICCIE), 2015, : 111 - 113
  • [36] Unsupervised domain adaptation teacher-student network for retinal vessel segmentation via full-resolution refined model
    Yue, Kejuan
    Zhan, Lixin
    Wang, Zheng
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [37] Open-Set Domain Adaptation via Feature Clustering and Separation for Fault Diagnosis
    Wang, Xuan
    Shi, Zhangsong
    Sun, Shiyan
    Li, Lin
    IEEE SENSORS JOURNAL, 2024, 24 (10) : 16347 - 16361
  • [38] Open-set Short Utterance Forensic Speaker Verification using Teacher-Student Network with Explicit Inductive Bias
    Sang, Mufan
    Xia, Wei
    Hansen, John H. L.
    INTERSPEECH 2020, 2020, : 2262 - 2266
  • [39] Teaching con Cariño: Teacher Agency and Teacher-Student Relationships in a Dual Language Classroom
    Mendizabal, Paola G.
    JOURNAL OF LATINOS AND EDUCATION, 2025, 24 (01) : 62 - 75
  • [40] IMPROVED OPEN SET DOMAIN ADAPTATION WITH BACKPROPAGATION
    Fu, Jiahui
    Wu, Xiaofu
    Zhang, Suofei
    Yan, Jun
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2506 - 2510