Introducing Routing Uncertainty in Capsule Networks

被引:0
|
作者
Ribeiro, Fabio De Sousa [1 ]
Leontidis, Georgios [2 ]
Kollias, Stefanos [1 ]
机构
[1] Univ Lincoln, Machine Learning Grp, Lincoln, England
[2] Univ Aberdeen, Dept Comp Sci, Aberdeen, Scotland
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020 | 2020年 / 33卷
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Rather than performing inefficient local iterative routing between adjacent capsule layers, we propose an alternative global view based on representing the inherent uncertainty in part-object assignment. In our formulation, the local routing iterations are replaced with variational inference of part-object connections in a probabilistic capsule network, leading to a significant speedup without sacrificing performance. In this way, global context is also considered when routing capsules by introducing global latent variables that have direct influence on the objective function, and are updated discriminatively in accordance with the minimum description length (MDL) principle. We focus on enhancing capsule network properties, and perform a thorough evaluation on pose-aware tasks, observing improvements in performance over previous approaches whilst being more computationally efficient.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] ON INTRODUCING THE UNCERTAINTY PRINCIPLE
    MUHA, GM
    MUHA, DW
    JOURNAL OF CHEMICAL EDUCATION, 1986, 63 (06) : 525 - 527
  • [22] An Improved Capsule Network Based on Capsule Filter Routing
    Wang, Wei
    Lee, Feifei
    Yang, Shuai
    Chen, Qiu
    IEEE ACCESS, 2021, 9 : 109374 - 109383
  • [23] Uncertainty in Multi-Commodity Routing Networks: When does it help?
    Sekar, Shreyas
    Zheng, Liyuan
    Ratliff, Lillian J.
    Zhang, Baosen
    2018 ANNUAL AMERICAN CONTROL CONFERENCE (ACC), 2018, : 6553 - 6558
  • [24] Capsule Network with Shortcut Routing
    Thanh Vu Dang
    Hoang Trong Vo
    Yu, Gwang Hyun
    Kim, Jin Young
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2021, E104A (08) : 1043 - 1050
  • [25] Capsule Networks With Word-Attention Dynamic Routing for Cultural Relics Relation Extraction
    Zhang, Min
    Geng, Guohua
    IEEE ACCESS, 2020, 8 (08): : 94236 - 94244
  • [26] Compressive sensing with perceptron based routing for varying traffic intensity based on capsule networks
    Alagirisamy, Mukil
    Chow, Chee-Onn
    Bin Noordin, Kamarul Ariffin
    COMPUTERS & ELECTRICAL ENGINEERING, 2019, 79
  • [27] Interactive Capsule Networks with a Novel Dynamic Routing Mechanism for Implicit Discourse Relation Recognition
    Xu, Jing
    He, Ruifang
    Zhao, Haodong
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [28] Interpretable capsule networks via self attention routing on spatially invariant feature surfaces
    Peizhang Li
    Jiyuan Ru
    Qing Fei
    Zhen Chen
    Bo Wang
    Scientific Reports, 15 (1)
  • [29] PointCaps: Raw point cloud processing using capsule networks with Euclidean distance routing
    Denipitiyage, Dishanika
    Jayasundara, Vinoj
    Rodrigo, Ranga
    Edussooriya, Chamira U. S.
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 88
  • [30] Enhancing classification efficiency in capsule networks through windowed routing: tackling gradient vanishing, dynamic routing, and computational complexity challenges
    Chen, Gangqi
    Mao, Zhaoyong
    Shen, Junge
    Hou, Dongdong
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (01)