Adaptive dynamic inference for few-shot left atrium segmentation

被引:0
|
作者
Chen, Jun [1 ,2 ]
Li, Xuejiao [2 ]
Zhang, Heye [2 ]
Cho, Yongwon [3 ]
Hwang, Sung Ho [3 ,4 ]
Gao, Zhifan [2 ]
Yang, Guang [5 ,6 ,7 ,8 ]
机构
[1] Jiangsu Univ, Sch Comp Sci & Commun Engn, Zhenjiang, Jiangsu, Peoples R China
[2] Sun Yat sen Univ, Sch Biomed Engn, Shenzhen 518107, Guangdong, Peoples R China
[3] Korea Univ, Anam Hosp, Dept Radiol, 73 Goryeodae Ro, Seoul 02841, South Korea
[4] Korea Univ, AI Ctr, Anam Hosp, 73 Goryeodae Ro, Seoul 02841, South Korea
[5] Imperial Coll London, Bioengn Dept & Imperial X, London W12 7SL, England
[6] Imperial Coll London, Natl Heart & Lung Inst, London SW7 2AZ, England
[7] Royal Brompton Hosp, Cardiovasc Res Ctr, London SW3 6NP, England
[8] Kings Coll London, Sch Biomed Engn & Imaging Sci, London WC2R 2LS, England
基金
英国医学研究理事会; 中国国家自然科学基金; 中国博士后科学基金;
关键词
Atrial fibrillation; LCE CMR; LA segmentation; Few-shot learning; WHOLE HEART SEGMENTATION; CONSISTENCY; FRAMEWORK;
D O I
10.1016/j.media.2024.103321
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate segmentation of the left atrium (LA) from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images is crucial for aiding the treatment of patients with atrial fibrillation. Few-shot learning holds significant potential for achieving accurate LA segmentation with low demand on high-cost labeled LGE CMR data and fast generalization across different centers. However, accurate LA segmentation with few-shot learning is a challenging task due to the low-intensity contrast between the LA and other neighboring organs in LGE CMR images. To address this issue, we propose an Adaptive Dynamic Inference Network (ADINet) that explicitly models the differences between the foreground and background. Specifically, ADINet leverages dynamic collaborative inference (DCI) and dynamic reverse inference (DRI) to adaptively allocate semantic- aware and spatial-specific convolution weights and indication information. These allocations are conditioned on the support foreground and background knowledge, utilizing pixel-wise correlations, for different spatial positions of query images. The convolution weights adapt to different visual patterns based on spatial positions, enabling effective encoding of differences between foreground and background regions. Meanwhile, the indication information adapts to the background visual pattern to reversely decode foreground LA regions, leveraging their spatial complementarity. To promote the learning of ADINet, we propose hierarchical supervision, which enforces spatial consistency and differences between the background and foreground regions through pixel-wise semantic supervision and pixel-pixel correlation supervision. We demonstrated the performance of ADINet on three LGE CMR datasets from different centers. Compared to state-of-the-art methods with ten available samples, ADINet yielded better segmentation performance in terms of four metrics.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Integrative Few-Shot Learning for Classification and Segmentation
    Kang, Dahyun
    Cho, Minsu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9969 - 9980
  • [42] Dense affinity matching for Few-Shot Segmentation
    Chen, Hao
    Dong, Yonghan
    Lu, Zheming
    Yu, Yunlong
    Li, Yingming
    Han, Jungong
    Zhang, Zhongfei
    NEUROCOMPUTING, 2024, 577
  • [43] Dense Gaussian Processes for Few-Shot Segmentation
    Johnander, Joakim
    Edstedt, Johan
    Felsberg, Michael
    Khan, Fahad Shahbaz
    Danelljan, Martin
    COMPUTER VISION, ECCV 2022, PT XXIX, 2022, 13689 : 217 - 234
  • [44] LEARNING WITH MEMORY FOR FEW-SHOT SEMANTIC SEGMENTATION
    Lu, Hongchao
    Wei, Chao
    Deng, Zhidong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 629 - 633
  • [45] Query Adaptive Transformer and Multiprototype Rectification for Few-Shot Remote Sensing Image Segmentation
    Gao, Tianyi
    Gao, Zhi
    Ji, Hong
    Ao, Wei
    Song, Weiwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [46] A Transformer-based Adaptive Prototype Matching Network for Few-Shot Semantic Segmentation
    Chen, Sihan
    Chen, Yadang
    Zheng, Yuhui
    Yang, Zhi-Xin
    Wu, Enhua
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 659 - 667
  • [47] Domain-Adaptive Few-Shot Learning
    Zhao, An
    Ding, Mingyu
    Lu, Zhiwu
    Xiang, Tao
    Niu, Yulei
    Guan, Jiechao
    Wen, Ji-Rong
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 1389 - 1398
  • [48] Few-Shot and Zero-Shot Semantic Segmentation for Food Images
    Honbu, Yuma
    Yanai, Keiji
    PROCEEDINGS OF THE 13TH INTERNATIONAL WORKSHOP ON MULTIMEDIA FOR COOKING AND EATING ACTIVITIES (CEA '21), 2021, : 25 - 28
  • [49] Few-shot video object segmentation with prototype evolution
    Mao, Binjie
    Liu, Xiyan
    Shi, Linsu
    Yu, Jiazhong
    Li, Fei
    Xiang, Shiming
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (10): : 5367 - 5382
  • [50] Query semantic reconstruction for background in few-shot segmentation
    Guan, Haoyan
    Spratling, Michael
    VISUAL COMPUTER, 2024, 40 (02): : 799 - 810