Information Bottleneck: Theory and Applications in Deep Learning

被引：9
|
作者：
Geiger, Bernhard C. [1 ]
Kubin, Gernot [2 ]
机构：
[1] Know Ctr GmbH, Inffeldgasse 13-6, A-8010 Graz, Austria
[2] Graz Univ Technol, Signal Proc & Speech Commun Lab, Inffeldgasse 16c, A-8010 Graz, Austria
来源：
ENTROPY | 2020年 / 22卷 / 12期
基金：
欧盟地平线“2020”;
关键词：
information bottleneck; deep learning; neural networks;
D O I：
10.3390/e22121408
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
引用
收藏
页数：4
相关论文
共 50 条
  • [1] On the information bottleneck theory of deep learning
    Saxe, Andrew M.
    Bansal, Yamini
    Dapello, Joel
    Advani, Madhu
    Kolchinsky, Artemy
    Tracey, Brendan D.
    Cox, David D.
    JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2019, 2019 (12):
  • [2] Successive Information Bottleneck and Applications in Deep Learning
    Yousfi, Yassine
    Akyol, Emrah
    2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 1210 - 1213
  • [3] Deep Learning and the Information Bottleneck Principle
    Tishby, Naftali
    Zaslavsky, Noga
    2015 IEEE INFORMATION THEORY WORKSHOP (ITW), 2015,
  • [4] Information Bottleneck in Deep Learning - A Semiotic Approach
    Musat, B.
    Andonie, R.
    INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2022, 17 (01)
  • [5] On the Difference between the Information Bottleneck and the Deep Information Bottleneck
    Wieczorek, Aleksander
    Roth, Volker
    ENTROPY, 2020, 22 (02)
  • [6] Information Bottleneck Theory Based Exploration of Cascade Learning
    Du, Xin
    Farrahi, Katayoun
    Niranjan, Mahesan
    ENTROPY, 2021, 23 (10)
  • [7] The information bottleneck problem and its applications in machine learning
    Goldfeld Z.
    Polyanskiy Y.
    IEEE Journal on Selected Areas in Information Theory, 2020, 1 (01): : 19 - 38
  • [8] Multimodal information bottleneck for deep reinforcement learning with multiple sensors
    You, Bang
    Liu, Huaping
    NEURAL NETWORKS, 2024, 176
  • [9] Deep representation learning for domain generalization with information bottleneck principle
    Zhang, Jiao
    Zhang, Xu-Yao
    Wang, Chuang
    Liu, Cheng-Lin
    PATTERN RECOGNITION, 2023, 143
  • [10] Robustness Enhancement Method of Deep Learning Model Based on Information Bottleneck
    Dong, Qingkuan
    He, Junlin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (06) : 2197 - 2204
12345