Domain-Invariant Label Propagation With Adaptive Graph Regularization

被引:0
|
作者
Zhang, Yanning [1 ]
Tao, Jianwen [1 ]
Yan, Liangda [2 ]
机构
[1] Ningbo Polytech, Inst Artificial Intelligence Applicat, Ningbo 315800, Peoples R China
[2] Zhejiang Business Technol Inst, Sch Elect Informat, Ningbo 315012, Zhejiang, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Adaptation models; Optimization; Deep learning; Representation learning; Training; Knowledge transfer; Upper bound; Robustness; Predictive models; Noise measurement; Domain adaptation; maximum mean discrepancy; adaptive graph Laplacian; label propagation;
D O I
10.1109/ACCESS.2024.3510889
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an effective machine learning paradigm, domain adaptation (DA) learning aims to enhance the learning performance of the target domain by utilizing other relevant but distinct domain(s) (referred to as the source domain(s)). The existing mainstream methods for DA mainly learn discriminative domain-invariant feature representations by combining the "pseudo labels" of the target domain to better achieve knowledge transfer. However, most existing methods alternate the optimization learning of domain-invariant features and the updating of the "pseudo labels" into two different stages, which makes them difficult to achieve optimal learning performance. In order to achieve joint optimization learning of updating the "pseudo labels" and domain-invariant feature representations, a framework of Domain-Invariant Label prOpagation (DILO) with adaptive graph regularization is proposed. By combining semi-supervised knowledge adaptation and label propagation on domain data, DILO jointly optimizes domain-invariant feature representations and target learning tasks in a unified framework, allowing these two objectives to mutually benefit. Specifically, by introducing the concept of soft labels, a joint distribution measurement model is established to simultaneously alleviate both marginal and conditional distribution differences between different domains; constructing an adaptive probability graph model to enhance the robustness of label propagation. Moreover, a robust sigma -norm is applied to domain joint distribution measurement and inductive learning models to form a unified objective optimization formulation. An effective optimization algorithm is proposed for addressing the optimization problem of DILO. Compared with several representative DA methods, the proposed method achieved better or comparable robustness in adaptation learning on four cross-domain visual datasets.
引用
收藏
页码:190728 / 190745
页数:18
相关论文
共 50 条
  • [1] Domain-Invariant Adaptive Graph Regularized Label Propagation for EEG-Based Emotion Recognition
    Tao, Jianwen
    Yan, Liangda
    He, Tao
    IEEE ACCESS, 2024, 12 : 126774 - 126792
  • [2] Domain-invariant Graph for Adaptive Semi-supervised Domain Adaptation
    Li, Jinfeng
    Liu, Weifeng
    Zhou, Yicong
    Yu, Jun
    Tao, Dapeng
    Xu, Changsheng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
  • [3] Exploring Implicit Domain-Invariant Features for Domain Adaptive Object Detection
    Lang, Qinghai
    Zhang, Lei
    Shi, Wenxu
    Chen, Weijie
    Pu, Shiliang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1816 - 1826
  • [4] Domain-invariant feature learning with label information integration for cross-domain classification
    Jiang L.
    Wu J.
    Zhao S.
    Li J.
    Neural Computing and Applications, 2024, 36 (21) : 13107 - 13126
  • [5] Adaptive Domain-Invariant Feature Extraction for Cross-Domain Linguistic Steganalysis
    Xue, Yiming
    Wu, Jiaxuan
    Ji, Ronghua
    Zhong, Ping
    Wen, Juan
    Peng, Wanli
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 920 - 933
  • [6] Label Efficient Regularization and Propagation for Graph Node Classification
    Xie, Tian
    Kannan, Rajgopal
    Kuo, C. -C. Jay
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 14856 - 14871
  • [7] Sparsity regularization label propagation for domain adaptation learning
    Tao, JianWen
    Hu, Wenjun
    Wang, Shitong
    NEUROCOMPUTING, 2014, 139 : 202 - 219
  • [8] Domain-Invariant Feature Learning for Domain Adaptation
    Tu, Ching-Ting
    Lin, Hsiau-Wen
    Lin, Hwei Jen
    Tokuyama, Yoshimasa
    Chu, Chia-Hung
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (03)
  • [9] Support and Invertibility in Domain-Invariant Representations
    Johansson, Fredrik D.
    Sontag, David
    Ranganath, Rajesh
    22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89 : 527 - 536
  • [10] Domain-Invariant Prototypes for Semantic Segmentation
    Yang, Zhengeng
    Yu, Hongshan
    Sun, Wei
    Cheng, Li
    Mian, Ajmal
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7614 - 7627