Overview of the Frontier Progress of Causal Machine Learning

被引:0
|
作者
Li J. [1 ,2 ]
Xiong R. [1 ,2 ]
Lan Y. [3 ]
Pang L. [4 ]
Guo J. [1 ,2 ]
Cheng X. [1 ,2 ]
机构
[1] CAS Key Laboratory of Network Data Science and Technology, Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[2] University of Chinese Academy of Sciences, Beijing
[3] Institute for AI Industry Research, Tsinghua University, Beijing
[4] Data Intelligence System Research Center, Institute of Computing Technology, Chinese Academy of Sciences, Beijing
基金
中国国家自然科学基金;
关键词
Artificial intelligence; Causal inference; Causal relationship; Deep learning; Machine learning; Spurious correlation;
D O I
10.7544/issn1000-1239.202110780
中图分类号
学科分类号
摘要
Machine learning is one of the important technical means to realize artificial intelligence, and it has important applications in the fields of computer vision, natural language processing, search engines and recommendation systems. Existing machine learning methods often focus on the correlations in the data and ignore the causality. With the increase in application requirements, their drawbacks have gradually begun to appear, facing a series of urgent problems in terms of interpretability, transferability, robustness, and fairness. In order to solve these problems, researchers have begun to re-examine the necessity of modeling causal relationship, and related methods have become one of the recent research hotspots. We organize and summarize the work of applying causal techniques and ideas to solve practical problems in the field of machine learning in recent years, and sort out the development venation of this emerging research direction. First, we briefly introduce the closely related causal theory to machine learning. Then, we classify and introduce each work based on the needs of different problems in machine learning, explain their differences and connections from the perspective of solution ideas and technical means. Finally, we summarize the current situation of causal machine learning, and make predictions and prospects for future development trends. © 2023, Science Press. All right reserved.
引用
收藏
页码:59 / 84
页数:25
相关论文
共 188 条
  • [1] LeCun Y, Bengio Y, Hinton G., Deep learning[J], Nature, 521, 7553, (2015)
  • [2] He Kaiming, Zhang Xiangyu, Ren Shaoqing, Et al., Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification[C], Proc of the IEEE Int Conf on Computer Vision, pp. 1026-1034, (2015)
  • [3] Brock A, Donahue J, Simonyan K., Large scale GAN training for high fidelity natural image synthesis [C/OL], Proc of the 7th Int Conf on Learning Representations, (2019)
  • [4] Brown T B, Mann B, Ryder N, Et al., Language models are few-shot learners[C], Proc of the 34th Int Conf on Neural Information Processing Systems, pp. 1877-1901, (2020)
  • [5] Silver D, Huang A, Maddison C J, Et al., Mastering the game of Go with deep neural networks and tree search[J], Nature, 529, 7587, (2016)
  • [6] Senior A W, Evans R, Jumper J, Et al., Improved protein structure prediction using potentials from deep learning[J], Nature, 577, 7792, (2020)
  • [7] Gunning D, Aha D., DARPA's explainable artificial intelligence (XAI) program[J], AI Magazine, 40, 2, (2019)
  • [8] Szegedy C, Zaremba W, Sutskever I, Et al., Intriguing properties of neural networks[C/OL], Proc of the 2nd Int Conf on Learning Representations, (2014)
  • [9] Barocas S, Hardt M, Narayanan A., Fairness in machine learning [EB/OL], (2017)
  • [10] Pearl J, Mackenzie D., The Book of Why: The New Science of Cause and Effect, (2018)