Adaptive dynamic inference for few-shot left atrium segmentation

被引:0
|
作者
Chen, Jun [1 ,2 ]
Li, Xuejiao [2 ]
Zhang, Heye [2 ]
Cho, Yongwon [3 ]
Hwang, Sung Ho [3 ,4 ]
Gao, Zhifan [2 ]
Yang, Guang [5 ,6 ,7 ,8 ]
机构
[1] Jiangsu Univ, Sch Comp Sci & Commun Engn, Zhenjiang, Jiangsu, Peoples R China
[2] Sun Yat sen Univ, Sch Biomed Engn, Shenzhen 518107, Guangdong, Peoples R China
[3] Korea Univ, Anam Hosp, Dept Radiol, 73 Goryeodae Ro, Seoul 02841, South Korea
[4] Korea Univ, AI Ctr, Anam Hosp, 73 Goryeodae Ro, Seoul 02841, South Korea
[5] Imperial Coll London, Bioengn Dept & Imperial X, London W12 7SL, England
[6] Imperial Coll London, Natl Heart & Lung Inst, London SW7 2AZ, England
[7] Royal Brompton Hosp, Cardiovasc Res Ctr, London SW3 6NP, England
[8] Kings Coll London, Sch Biomed Engn & Imaging Sci, London WC2R 2LS, England
基金
英国医学研究理事会; 中国国家自然科学基金; 中国博士后科学基金;
关键词
Atrial fibrillation; LCE CMR; LA segmentation; Few-shot learning; WHOLE HEART SEGMENTATION; CONSISTENCY; FRAMEWORK;
D O I
10.1016/j.media.2024.103321
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate segmentation of the left atrium (LA) from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images is crucial for aiding the treatment of patients with atrial fibrillation. Few-shot learning holds significant potential for achieving accurate LA segmentation with low demand on high-cost labeled LGE CMR data and fast generalization across different centers. However, accurate LA segmentation with few-shot learning is a challenging task due to the low-intensity contrast between the LA and other neighboring organs in LGE CMR images. To address this issue, we propose an Adaptive Dynamic Inference Network (ADINet) that explicitly models the differences between the foreground and background. Specifically, ADINet leverages dynamic collaborative inference (DCI) and dynamic reverse inference (DRI) to adaptively allocate semantic- aware and spatial-specific convolution weights and indication information. These allocations are conditioned on the support foreground and background knowledge, utilizing pixel-wise correlations, for different spatial positions of query images. The convolution weights adapt to different visual patterns based on spatial positions, enabling effective encoding of differences between foreground and background regions. Meanwhile, the indication information adapts to the background visual pattern to reversely decode foreground LA regions, leveraging their spatial complementarity. To promote the learning of ADINet, we propose hierarchical supervision, which enforces spatial consistency and differences between the background and foreground regions through pixel-wise semantic supervision and pixel-pixel correlation supervision. We demonstrated the performance of ADINet on three LGE CMR datasets from different centers. Compared to state-of-the-art methods with ten available samples, ADINet yielded better segmentation performance in terms of four metrics.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Attentional prototype inference for few-shot segmentation
    Sun, Haoliang
    Lu, Xiankai
    Wang, Haochen
    Yin, Yilong
    Zhen, Xiantong
    Snoek, Cees G. M.
    Shao, Ling
    PATTERN RECOGNITION, 2023, 142
  • [2] Adaptive Agent Transformer for Few-Shot Segmentation
    Wang, Yuan
    Sun, Rui
    Zhang, Zhe
    Zhang, Tianzhu
    COMPUTER VISION, ECCV 2022, PT XXIX, 2022, 13689 : 36 - 52
  • [3] Variational Prototype Inference for Few-Shot Semantic Segmentation
    Wang, Haochen
    Yang, Yandan
    Cao, Xianbin
    Zhen, Xiantong
    Snoek, Cees
    Shao, Ling
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 525 - 534
  • [4] Dynamic Transformer for Few-shot Instance Segmentation
    Wang, Haochen
    Liu, Jie
    Liu, Yongtuo
    Maji, Subhransu
    Sonke, Jan-Jakob
    Gavves, Efstratios
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2969 - 2977
  • [5] AMP: Adaptive Masked Proxies for Few-Shot Segmentation
    Siam, Mennatullah
    Oreshkin, Boris N.
    Jagersand, Martin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5248 - 5257
  • [6] Adaptive Prototype Learning and Allocation for Few-Shot Segmentation
    Li, Gen
    Jampani, Varun
    Sevilla-Lara, Laura
    Sun, Deqing
    Kim, Jonghyun
    Kim, Joongkyu
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8330 - 8339
  • [7] Temporal Transductive Inference for Few-Shot Video Object Segmentation
    Siam, Mennatullah
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,
  • [8] Hierarchical Relational Inference for Few-Shot Learning in 3D Left Atrial Segmentation
    Li, Xuejiao
    Chen, Jun
    Zhang, Heye
    Cho, Yongwon
    Hwang, Sung Ho
    Gao, Zhifan
    Yang, Guang
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (05): : 1 - 16
  • [9] Dynamic Extension Nets for Few-shot Semantic Segmentation
    Liu, Lizhao
    Cao, Junyi
    Liu, Minqian
    Guo, Yong
    Chen, Qi
    Tan, Mingkui
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1441 - 1449
  • [10] Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation
    Liu, Jie
    Bao, Yanqi
    Xie, Guo-Sen
    Xiong, Huan
    Sonke, Jan-Jakob
    Gavves, Efstratios
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11543 - 11552