Learning Causal Representations for Robust Domain Adaptation

被引:25
|
作者
Yang, Shuai [1 ]
Yu, Kui [1 ]
Cao, Fuyuan [2 ]
Liu, Lin [3 ]
Wang, Hao [1 ]
Li, Jiuyong [3 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Key Lab Knowledge Engn Big Data, Minist Educ, Hefei 230601, Peoples R China
[2] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Peoples R China
[3] Univ South Australia, UniSA STEM, Adelaide, SA 5095, Australia
基金
澳大利亚研究理事会; 中国国家自然科学基金;
关键词
Dogs; Data models; Predictive models; Markov processes; Adaptation models; Training; Sentiment analysis; Domain adaptation; causal discovery; autoencoder; FEATURE-SELECTION; RELEVANCE;
D O I
10.1109/TKDE.2021.3119185
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, we investigate a challenging problem, namely, robust domain adaptation, where data from only a single well-labeled source domain are available in the training phase. To address this problem, assuming that the causal relationships between the features and the class variable are robust across domains, we propose a novel causal autoencoder (CAE), which integrates a deep autoencoder and a causal structure learning model to learn causal representations using data from a single source domain. Specifically, a deep autoencoder model is adopted to learn the low-dimensional representations, and a causal structure learning model is designed to separate the low-dimensional representations into two groups: causal representations and task-irrelevant representations. Using three real-world datasets, the experiments have validated the effectiveness of CAE, in comparison with eleven state-of-the-art methods.
引用
收藏
页码:2750 / 2764
页数:15
相关论文
共 50 条
  • [11] Learning Robust Feature Transformation for Domain Adaptation
    Wang, Wei
    Wang, Hao
    Ran, Zhi-Yong
    He, Ran
    PATTERN RECOGNITION, 2021, 114
  • [12] Exploiting Causal Structure for Robust Model Selection in Unsupervised Domain Adaptation
    Kyono T.
    van der Schaar M.
    Kyono, Trent (tmkyono@gmail.com), 2021, Institute of Electrical and Electronics Engineers Inc. (02): : 494 - 507
  • [13] Robust Domain Adaptation: Representations, Weights and Inductive Bias (Extended Abstract)
    Bouvier, Victor
    Very, Philippe
    Chastagnol, Clement
    Tami, Myriam
    Hudelot, Celine
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4750 - 4754
  • [14] Unsupervised domain adaptation via causal-contrastive learning
    Xing Wei
    Wenhao Jiang
    Fan Yang
    Chong Zhao
    Yang Lu
    Benhong Zhang
    Xiang Bi
    The Journal of Supercomputing, 81 (5)
  • [15] Counterfactual Contrastive Learning: Robust Representations via Causal Image Synthesis
    Roschewitz, Melanie
    Ribeiro, Fabio de Sousa
    Xia, Tian
    Khara, Galvin
    Glocker, Ben
    DATA ENGINEERING IN MEDICAL IMAGING, DEMI 2024, 2025, 15265 : 22 - 32
  • [16] Learning cross-domain representations by vision transformer for unsupervised domain adaptation
    Ye, Yifan
    Fu, Shuai
    Chen, Jing
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (15): : 10847 - 10860
  • [17] Learning smooth representations with generalized softmax for unsupervised domain adaptation
    Han, Chao
    Lei, Yu
    Xie, Yu
    Zhou, Deyun
    Gong, Maoguo
    INFORMATION SCIENCES, 2021, 544 : 415 - 426
  • [18] General Causal Representations In The Medical Domain
    Mazlack, Lawrence J.
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS, VOLS 1-4, 2009, : 1611 - 1615
  • [19] Robust domain adaptation
    Mansour, Yishay
    Schain, Mariano
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2014, 71 (04) : 365 - 380
  • [20] Robust domain adaptation
    Yishay Mansour
    Mariano Schain
    Annals of Mathematics and Artificial Intelligence, 2014, 71 : 365 - 380