Stable Synthetic Control with Anomaly Detection for Causal Inference

被引:0
|
作者
Li, Qiang [1 ]
Sun, Yiqiao [2 ]
Pang, Linsey [3 ]
Sun, Liang [4 ]
Wen, Qingsong [4 ]
机构
[1] Wilfrid Laurier Univ, Waterloo, ON, Canada
[2] Bytedance, Cambridge, England
[3] Salesforce, San Francisco, CA USA
[4] Alibaba Grp, Hangzhou, Peoples R China
关键词
Stable Synthetic Control; Anomaly Detection; Causal Inference; Observational Study;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The study of treatment effects is an essential area in causal inference that has received extensive attention in the sciences. When access to counterfactual groups and experimental settings is limited, the synthetic control method (SCM) emerges as a key approach for observational studies. However, conventional SCM techniques mainly concentrate on addressing confounding issues in the pre-treatment period, often overlooking the confounding effects of control groups in the post-treatment period. In this paper, we propose a new approach named Stable-SC, which integrates synthetic control with anomaly detection algorithms to mitigate the influence of confounding factors in both the pre- and post-treatment periods. Our algorithm incorporates an anomaly-detection process that identifies trends and distance anomalies within control groups, significantly impacting SCM estimation results. Subsequently, we employ a re-weighting schema to adjust the significance of these abnormal groups and utilize the Difference-in-Differences estimator to assess causal effects. Through extensive experimentation with multiple simulated and real-world datasets, we demonstrate that our Stable-SC approach yields more robust estimates compared to other existing methods in the literature. Furthermore, we have successfully applied our proposed framework in diverse business scenarios within a prominent retail company, where the need for stable and robust A/B testing is paramount in quantifying causal effects.
引用
收藏
页码:770 / 778
页数:9
相关论文
共 50 条
  • [1] A Causal Inference Look at Unsupervised Video Anomaly Detection
    Lin, Xiangru
    Chen, Yuyang
    Li, Guanbin
    Yu, Yizhou
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1620 - 1629
  • [2] Proximal Causal Inference for Synthetic Control with Surrogates
    Liu, Jizhou
    Tchetgen, Eric J. Tchetgen
    Varjao, Carlos
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [3] A causal inference method for canal safety anomaly detection based on structural causal model and GBDT
    Li, Hairui
    Liu, Xuemei
    Huai, Xianfeng
    Chen, Xiaolu
    LHB-HYDROSCIENCE JOURNAL, 2023, 109 (01)
  • [4] Anomaly Detection in Network Traffic Based on Statistical Inference and α-Stable Modeling
    Simmross-Wattenberg, Federico
    Ignacio Asensio-Perez, Juan
    Casaseca-de-la-Higuera, Pablo
    Martin-Fernandez, Marcos
    Dimitriadis, Ioannis A.
    Alberola-Lopez, Carlos
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2011, 8 (04) : 494 - 509
  • [5] Dynamical Systems Theory for Causal Inference with Application to Synthetic Control Methods
    Ding, Yi
    Toulis, Panos
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 1888 - 1897
  • [6] Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models
    Xu, Yiqing
    POLITICAL ANALYSIS, 2017, 25 (01) : 57 - 76
  • [7] Stable Knowledge Tracing Using Causal Inference
    Zhu, Jia
    Ma, Xiaodong
    Huang, Changqin
    IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2024, 17 : 124 - 134
  • [8] Double and Single Descent in Causal Inference with an Application to High-Dimensional Synthetic Control
    Spiess, Jann
    Imbens, Guido
    Venugopal, Amar
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Detection of unfaithfulness and robust causal inference
    Zhang, Jiji
    Spirtes, Peter
    MINDS AND MACHINES, 2008, 18 (02) : 239 - 271
  • [10] On Root Cause Localization and Anomaly Mitigation through Causal Inference
    Han, Xiao
    Zhang, Lu
    Wu, Yongkai
    Yuan, Shuhan
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 699 - 708