Understanding Deep Learning with Statistical Relevance

被引:10
|
作者
Raez, Tim [1 ]
机构
[1] Univ Bern, Inst Philosophy, Bern, Switzerland
关键词
D O I
10.1017/psa.2021.12
中图分类号
N09 [自然科学史]; B [哲学、宗教];
学科分类号
01 ; 0101 ; 010108 ; 060207 ; 060305 ; 0712 ;
摘要
This paper argues that a notion of statistical explanation, based on Salmon's statistical relevance model, can help us better understand deep neural networks. It is proved that homogeneous partitions, the core notion of Salmon's model, are equivalent to minimal sufficient statistics, an important notion from statistical inference. This establishes a link to deep neural networks via the so-called Information Bottleneck method, an information-theoretic framework, according to which deep neural networks implicitly solve an optimization problem that generalizes minimal sufficient statistics. The resulting notion of statistical explanation is general, mathematical, and subcausal.
引用
收藏
页码:20 / 41
页数:22
相关论文
共 50 条
  • [41] Deep Reinforcement Learning at the Edge of the Statistical Precipice
    Agarwal, Rishabh
    Schwarzer, Max
    Castro, Pablo Samuel
    Courville, Aaron
    Bellemare, Marc G.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [42] Statistical Deep Learning for Spatial and Spatiotemporal Data
    Wikle, Christopher K.
    Zammit-Mangion, Andrew
    ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION, 2023, 10 : 247 - 270
  • [43] Merging two cultures: Deep and statistical learning
    Bhadra, Anindya
    Datta, Jyotishka
    Polson, Nicholas G.
    Sokolov, Vadim
    Xu, Jianeng
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2024, 16 (02)
  • [44] ON THE RELEVANCE OF STATISTICAL RELEVANCE THEORY
    TURNER, SP
    THEORY AND DECISION, 1982, 14 (02) : 195 - 205
  • [45] The relevance of a sociocultural perspective for understanding learning and development in older age
    Zittoun, Tania
    Baucal, Aleksandar
    LEARNING CULTURE AND SOCIAL INTERACTION, 2021, 28
  • [46] An Active Learning Approach for Statistical Spoken Language Understanding
    Garcia, Fernando
    Hurtado, Lluis-F.
    Sanchis, Emilio
    Segarra, Encarna
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, 2011, 7042 : 565 - 572
  • [47] Understanding climate change with statistical downscaling and machine learning
    Jebeile, Julie
    Lam, Vincent
    Raez, Tim
    SYNTHESE, 2021, 199 (1-2) : 1877 - 1897
  • [48] Breadth and relevance of multivariable inquiry supports deep understanding of science practice
    Lesperance, Rosiane
    Kuhn, Deanna
    SCIENCE EDUCATION, 2023, 107 (01) : 71 - 88
  • [49] Understanding climate change with statistical downscaling and machine learning
    Julie Jebeile
    Vincent Lam
    Tim Räz
    Synthese, 2021, 199 : 1877 - 1897
  • [50] Understanding deep learning is also a job for physicists
    Zdeborova, Lenka
    NATURE PHYSICS, 2020, 16 (06) : 602 - 604