Learning Causal Representations for Robust Domain Adaptation

被引:25
|
作者
Yang, Shuai [1 ]
Yu, Kui [1 ]
Cao, Fuyuan [2 ]
Liu, Lin [3 ]
Wang, Hao [1 ]
Li, Jiuyong [3 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Key Lab Knowledge Engn Big Data, Minist Educ, Hefei 230601, Peoples R China
[2] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Peoples R China
[3] Univ South Australia, UniSA STEM, Adelaide, SA 5095, Australia
基金
澳大利亚研究理事会; 中国国家自然科学基金;
关键词
Dogs; Data models; Predictive models; Markov processes; Adaptation models; Training; Sentiment analysis; Domain adaptation; causal discovery; autoencoder; FEATURE-SELECTION; RELEVANCE;
D O I
10.1109/TKDE.2021.3119185
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, we investigate a challenging problem, namely, robust domain adaptation, where data from only a single well-labeled source domain are available in the training phase. To address this problem, assuming that the causal relationships between the features and the class variable are robust across domains, we propose a novel causal autoencoder (CAE), which integrates a deep autoencoder and a causal structure learning model to learn causal representations using data from a single source domain. Specifically, a deep autoencoder model is adopted to learn the low-dimensional representations, and a causal structure learning model is designed to separate the low-dimensional representations into two groups: causal representations and task-irrelevant representations. Using three real-world datasets, the experiments have validated the effectiveness of CAE, in comparison with eleven state-of-the-art methods.
引用
收藏
页码:2750 / 2764
页数:15
相关论文
共 50 条
  • [1] Integrating causal representations with domain adaptation for fault diagnosis
    Jiang, Ming
    Zhou, Kuang
    Gao, Jiahui
    Zhang, Fode
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2025, 260
  • [2] On Learning Invariant Representations for Domain Adaptation
    Zhao, Han
    des Combes, Remi Tachet
    Zhang, Kun
    Gordon, Geoffrey J.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [3] Robust Causal Domain Adaptation in a Simple Diagnostic Setting
    van Ommen, Thijs
    PROCEEDINGS OF THE ELEVENTH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITIES: THEORIES AND APPLICATIONS (ISIPTA 2019), 2019, 103 : 424 - 429
  • [4] Robust Domain Adaptation: Representations, Weights and Inductive Bias
    Bouvier, Victor
    Very, Philippe
    Chastagnol, Clement
    Tami, Myriam
    Hudelot, Celine
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT I, 2021, 12457 : 353 - 377
  • [5] Learning Semantic Representations for Unsupervised Domain Adaptation
    Xie, Shaoan
    Zheng, Zibin
    Chen, Liang
    Chen, Chuan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [6] Learning explicitly transferable representations for domain adaptation
    Jing, Mengmeng
    Li, Jingjing
    Lu, Ke
    Zhu, Lei
    Yang, Yang
    NEURAL NETWORKS, 2020, 130 : 39 - 48
  • [7] Learning Transferrable Representations for Unsupervised Domain Adaptation
    Sener, Ozan
    Song, Hyun Oh
    Saxena, Ashutosh
    Savarese, Silvio
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [8] Learning Domain Invariant Word Representations for Parsing Domain Adaptation
    Qiao, Xiuming
    Zhang, Yue
    Zhao, Tiejun
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 801 - 813
  • [9] Domain Adaptation for Sentiment Analysis Using Robust Internal Representations
    Rostami, Mohammad
    Bose, Digbalay
    Narayanan, Shrikanth
    Galstyan, Aram
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 11484 - 11498
  • [10] Learning Robust Feature Transformation for Domain Adaptation
    Wang, Wei
    Wang, Hao
    Ran, Zhi-Yong
    He, Ran
    Pattern Recognition, 2021, 114