Introducing Routing Uncertainty in Capsule Networks

被引:0
|
作者
Ribeiro, Fabio De Sousa [1 ]
Leontidis, Georgios [2 ]
Kollias, Stefanos [1 ]
机构
[1] Univ Lincoln, Machine Learning Grp, Lincoln, England
[2] Univ Aberdeen, Dept Comp Sci, Aberdeen, Scotland
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020 | 2020年 / 33卷
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Rather than performing inefficient local iterative routing between adjacent capsule layers, we propose an alternative global view based on representing the inherent uncertainty in part-object assignment. In our formulation, the local routing iterations are replaced with variational inference of part-object connections in a probabilistic capsule network, leading to a significant speedup without sacrificing performance. In this way, global context is also considered when routing capsules by introducing global latent variables that have direct influence on the objective function, and are updated discriminatively in accordance with the minimum description length (MDL) principle. We focus on enhancing capsule network properties, and perform a thorough evaluation on pose-aware tasks, observing improvements in performance over previous approaches whilst being more computationally efficient.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Capsule Networks with Routing Annealing
    Renzulli, Riccardo
    Tartaglione, Enzo
    Fiandrotti, Attilio
    Grangetto, Marco
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT I, 2021, 12891 : 529 - 540
  • [2] Self-Routing Capsule Networks
    Hahn, Taeyoung
    Pyeon, Myeongjang
    Kim, Gunhee
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [3] Simplified Routing Mechanism for Capsule Networks
    Hollosi, Janos
    Ballagi, Aron
    Pozna, Claudiu Radu
    ALGORITHMS, 2023, 16 (07)
  • [4] Capsule Networks With Residual Pose Routing
    Liu, Yi
    Cheng, De
    Zhang, Dingwen
    Xu, Shoukun
    Han, Jungong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (02) : 2648 - 2661
  • [5] Capsule Networks Need an Improved Routing Algorithm
    Paik, Inyoung
    Kwak, Taeyeong
    Kim, Injung
    ASIAN CONFERENCE ON MACHINE LEARNING, VOL 101, 2019, 101 : 489 - 502
  • [6] Capsule Graph Neural Networks with EM Routing
    Lei, Yu
    Zhang, Jing
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3191 - 3195
  • [7] Investigating Capsule Networks with Dynamic Routing for Text Classification
    Zhao, Wei
    Ye, Jianbo
    Yang, Min
    Lei, Zeyang
    Zhang, Soufei
    Zhao, Zhou
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3110 - 3119
  • [8] Routing enhancement in wireless sensor networks based on capsule networks: A survey
    Abdullah, Hussein Jawad
    Abdullah, Mohammed Najm
    INTERNATIONAL JOURNAL OF NONLINEAR ANALYSIS AND APPLICATIONS, 2022, 13 (02): : 1229 - 1238
  • [9] Capsule networks with non-iterative cluster routing
    Zhao, Zhihao
    Cheng, Samuel
    NEURAL NETWORKS, 2021, 143 : 690 - 697
  • [10] Dynamic Routing Capsule Networks for Mild Cognitive Impairment Diagnosis
    Jiao, Zhicheng
    Huang, Pu
    Kam, Tae-Eui
    Hsu, Li-Ming
    Wu, Ye
    Zhang, Han
    Shen, Dinggang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV, 2019, 11767 : 620 - 628