Information Bottleneck: Theory and Applications in Deep Learning

被引：9
|
作者：
Geiger, Bernhard C. [1 ]
Kubin, Gernot [2 ]
机构：
[1] Know Ctr GmbH, Inffeldgasse 13-6, A-8010 Graz, Austria
[2] Graz Univ Technol, Signal Proc & Speech Commun Lab, Inffeldgasse 16c, A-8010 Graz, Austria
来源：
ENTROPY | 2020年 / 22卷 / 12期
基金：
欧盟地平线“2020”;
关键词：
information bottleneck; deep learning; neural networks;
D O I：
10.3390/e22121408
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
引用
收藏
页数：4
相关论文
共 50 条
  • [41] Learning to Abstract with Nonparametric Variational Information Bottleneck
    Behjati, Melika
    Fehr, Fabio
    Henderson, James
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 1576 - 1586
  • [42] Federated Learning via Disentangled Information Bottleneck
    Uddin, Md Palash
    Xiang, Yong
    Lu, Xuequan
    Yearwood, John
    Gao, Longxiang
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (03) : 1874 - 1889
  • [43] Information Bottleneck Learning Using Privileged Information for Visual Recognition
    Motiian, Saeid
    Piccirilli, Marco
    Adjeroh, Donald A.
    Doretto, Gianfranco
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1496 - 1505
  • [44] Learning Optimal Primary Capsules by Information Bottleneck
    Hu, Ming-fei
    Liu, Jian-wei
    Li, Wei-min
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT I, 2021, 12891 : 519 - 528
  • [45] Learning Optimal Representations with the Decodable Information Bottleneck
    Dubois, Yann
    Kiela, Douwe
    Schwab, David J.
    Vedantam, Ramakrishna
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [46] Applying the information bottleneck to statistical relational learning
    Riguzzi, Fabrizio
    Di Mauro, Nicola
    MACHINE LEARNING, 2012, 86 (01) : 89 - 114
  • [47] Direct Validation of the Information Bottleneck Principle for Deep Nets
    Elad, Adar
    Haviv, Doron
    Blau, Yochai
    Michaeli, Tomer
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 758 - 762
  • [48] Multitask Image Clustering via Deep Information Bottleneck
    Yan, Xiaoqiang
    Mao, Yiqiao
    Li, Mingyuan
    Ye, Yangdong
    Yu, Hui
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (03) : 1868 - 1881
  • [49] A NEW MULTI-INSTANCE LEARNING SCHEME FOR SCENE CATEGORIZATION USING INFORMATION BOTTLENECK THEORY
    Li Junyi
    Li Jianhua
    Li Xiang
    2011 INTERNATIONAL CONFERENCE ON INSTRUMENTATION, MEASUREMENT, CIRCUITS AND SYSTEMS (ICIMCS 2011), VOL 2: FUTURE COMMUNICATION AND NETWORKING, 2011, : 315 - 319
  • [50] Information Theory: Deep Ideas, Wide Perspectives, and Various Applications
    Ben-Gal, Irad
    Kagan, Evgeny
    ENTROPY, 2021, 23 (02)
12345