Information Bottleneck: Theory and Applications in Deep Learning

被引：9
|
作者：
Geiger, Bernhard C. [1 ]
Kubin, Gernot [2 ]
机构：
[1] Know Ctr GmbH, Inffeldgasse 13-6, A-8010 Graz, Austria
[2] Graz Univ Technol, Signal Proc & Speech Commun Lab, Inffeldgasse 16c, A-8010 Graz, Austria
来源：
ENTROPY | 2020年 / 22卷 / 12期
基金：
欧盟地平线“2020”;
关键词：
information bottleneck; deep learning; neural networks;
D O I：
10.3390/e22121408
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
引用
收藏
页数：4
相关论文
共 50 条
  • [21] Applications of game theory in deep learning: a survey
    Hazra, Tanmoy
    Anjaria, Kushal
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (06) : 8963 - 8994
  • [22] The Role of the Information Bottleneck in Representation Learning
    Vera, Matias
    Piantanida, Pablo
    Rey Vega, Leonardo
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 1580 - 1584
  • [23] Variational Information Bottleneck Regularized Deep Reinforcement Learning for Efficient Robotic Skill Adaptation
    Xiang, Guofei
    Dian, Songyi
    Du, Shaofeng
    Lv, Zhonghui
    SENSORS, 2023, 23 (02)
  • [24] DRIBO: Robust Deep Reinforcement Learning via Multi-View Information Bottleneck
    Fan, Jiameng
    Li, Wenchao
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [25] HVAC: Removing I/O Bottleneck for Large-Scale Deep Learning Applications
    Khan, Awais
    Paul, Arnab K.
    Zimmer, Christopher
    Oral, Sarp
    Dash, Sajal
    Atchley, Scott
    Wang, Feiyi
    2022 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2022), 2022, : 324 - 335
  • [26] Editorial: Information theory meets deep neural networks: theory and applications
    Zhang, Anguo
    Zhang, Qichun
    Zhao, Kai
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [27] Information Bottleneck Theory on Convolutional Neural Networks
    Li, Junjie
    Liu, Ding
    NEURAL PROCESSING LETTERS, 2021, 53 (02) : 1385 - 1400
  • [28] INCREMENTAL CLUSTERING USING INFORMATION BOTTLENECK THEORY
    Liu, Yongli
    Ouyang, Yuanxin
    Xiong, Zhang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2011, 25 (05) : 695 - 712
  • [29] Information Bottleneck Theory on Convolutional Neural Networks
    Junjie Li
    Ding Liu
    Neural Processing Letters, 2021, 53 : 1385 - 1400
  • [30] Deep Learning and Its Applications to Signal and Information Processing
    Yu, Dong
    Deng, Li
    IEEE SIGNAL PROCESSING MAGAZINE, 2011, 28 (01) : 145 - +
12345