Causal Representation Learning via Counterfactual Intervention

被引:0
|
作者
Li, Xiutian [1 ]
Sun, Siqi [1 ]
Feng, Rui [1 ,2 ,3 ]
机构
[1] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Sch Comp Sci, Shanghai 200433, Peoples R China
[2] Fudan Zhangjiang Inst, Shanghai 200120, Peoples R China
[3] Shanghai Collaborat Innovat Ctr Intelligent Visua, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing causal representation learning methods are based on the causal graph they build. However, due to the omission of bias within the causal graph, they essentially encourage models to learn biased causal effects in latent space. In this paper, we propose a novel causally disentangling framework that aims to learn unbiased causal effects. We first introduce inductive and dataset biases into traditional causal graph for the physical concepts of interest. Then, we eliminate the negative effects from these two biases by counterfactual intervention with reweighted loss function for learning unbiased causal effects. Finally, we employ the causal effects into the VAE to endow the latent representations with causality. In particular, we highlight that removing biases in this paper is regarded as a part of learning process for unbiased causal effects, which is crucial for causal disentanglement performance improvement. Through extensive experiments on real-world and synthetic datasets, we show that our method out-performs different baselines and obtains the state-of-the-art results for achieving causal representation learning.
引用
收藏
页码:3234 / 3242
页数:9
相关论文
共 50 条
  • [1] Debiasing NLU Models via Causal Intervention and Counterfactual Reasoning
    Tian, Bing
    Cao, Yixin
    Zhang, Yong
    Xing, Chunxiao
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 11376 - 11384
  • [2] CaRGI: Causal semantic representation learning via generative intervention for single domain generalization
    Shao, Youjia
    Wang, Shaohui
    Zhao, Wencang
    APPLIED SOFT COMPUTING, 2025, 173
  • [3] Disentangled Representation with Causal Constraints for Counterfactual Fairness
    Xu, Ziqi
    Liu, Jixue
    Cheng, Debo
    Li, Jiuyong
    Liu, Lin
    Wang, Ke
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT I, 2023, 13935 : 471 - 482
  • [4] Counterfactual Contrastive Learning: Robust Representations via Causal Image Synthesis
    Roschewitz, Melanie
    Ribeiro, Fabio de Sousa
    Xia, Tian
    Khara, Galvin
    Glocker, Ben
    DATA ENGINEERING IN MEDICAL IMAGING, DEMI 2024, 2025, 15265 : 22 - 32
  • [5] Causal Triplet: An Open Challenge for Intervention-centric Causal Representation Learning
    Liu, Yuejiang
    Alahi, Alexandre
    Russell, Chris
    Horn, Max
    Zietlow, Dominik
    Schoelkopf, Bernhard
    Locatello, Francesco
    CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 553 - 573
  • [6] Visual Commonsense Representation Learning via Causal Inference
    Wang, Tan
    Huang, Jianqiang
    Zhang, Hanwang
    Sun, Qianru
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1547 - 1550
  • [7] Stochastic intervention for causal inference via reinforcement learning
    Duong, Tri Dung
    Li, Qian
    Xu, Guandong
    NEUROCOMPUTING, 2022, 482 : 40 - 49
  • [8] Counterfactual Representation Learning with Balancing Weights
    Assaad, Serge
    Mehta, Nikhil
    Zeng, Shuxi
    Henao, Ricardo
    Tao, Chenyang
    Li, Fan
    Datta, Shounak
    Carin, Lawrence
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [9] Counterfactual Adversarial Learning with Representation Interpolation
    Wang, Wei
    Wang, Boxin
    Shi, Ning
    Li, Jinfeng
    Zhu, Bingyu
    Liu, Xiangyu
    Zhang, Rong
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 4809 - 4820
  • [10] Counterfactual Augmentation for Robust Authorship Representation Learning
    Hieu Man
    Thien Huu Nguyen
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 2347 - 2351