Cross-modality Attention Method for Medical Image Enhancement

被引:0
|
作者
Hu, Zebin [1 ]
Liu, Hao [1 ,2 ]
Li, Zhendong [1 ,2 ]
Yu, Zekuan [3 ]
机构
[1] Ningxia Univ, Sch Informat Engn, Yinchuan 750021, Ningxia, Peoples R China
[2] Collaborat Innovat Ctr Ningxia Big Data & Artific, Yinchuan 750021, Ningxia, Peoples R China
[3] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
基金
美国国家科学基金会;
关键词
Cross-modality learning; Generative adversarial model; Self-attention; Medical imaging; MRI;
D O I
10.1007/978-3-030-88010-1_34
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a cross-modality attention method (CMAM) for medical image enhancement especially in magnetic resonance imaging, which typically addresses the issue of exploiting the clean feature by generative model. To realize this goal, we distill the complementary information directly from different modalities of raw input images for reliable image generation. More specifically, our method integrates local features with exploiting the semantic high-order dependencies and thus explores attentional fields for robust feature representation learning. To evaluate the effectiveness of our CMAM, we conduct folds of experiments on the standard benchmark Brats 2019 dataset and experimental results demonstrate the effectiveness of CMAM.
引用
收藏
页码:411 / 423
页数:13
相关论文
共 50 条
  • [31] A Simple and Robust Framework for Cross-Modality Medical Image Segmentation applied to Vision Transformers
    Bastico, Matteo
    Ryckelynck, David
    Corte, Laurent
    Tillier, Yannick
    Decenciere, Etienne
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 4130 - 4140
  • [32] Joint image and feature adaptative attention-aware networks for cross-modality semantic segmentation
    Zhong, Qihuang
    Zeng, Fanzhou
    Liao, Fei
    Liu, Juhua
    Du, Bo
    Shang, Jedi S.
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (05): : 3665 - 3676
  • [33] Joint image and feature adaptative attention-aware networks for cross-modality semantic segmentation
    Qihuang Zhong
    Fanzhou Zeng
    Fei Liao
    Juhua Liu
    Bo Du
    Jedi S. Shang
    Neural Computing and Applications, 2023, 35 : 3665 - 3676
  • [34] Cross-Modality Medical Image Segmentation via Enhanced Feature Alignment and Cross Pseudo Supervision Learning
    Yang, Mingjing
    Wu, Zhicheng
    Zheng, Hanyu
    Huang, Liqin
    Ding, Wangbin
    Pan, Lin
    Yin, Lei
    DIAGNOSTICS, 2024, 14 (16)
  • [35] Interactive Image Segmentation with Cross-Modality Vision Transformers
    Li, Kun
    Vosselman, George
    Yang, Michael Ying
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 762 - 772
  • [36] Learning cross-modality features for image caption generation
    Zeng, Chao
    Kwong, Sam
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (07) : 2059 - 2070
  • [37] Cross-Modality Contrastive Learning for Hyperspectral Image Classification
    Hang, Renlong
    Qian, Xuwei
    Liu, Qingshan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [38] Cross-Modality Bridging and Knowledge Transferring for Image Understanding
    Yan, Chenggang
    Li, Liang
    Zhang, Chunjie
    Liu, Bingtao
    Zhang, Yongdong
    Dai, Qionghai
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (10) : 2675 - 2685
  • [39] Learning cross-modality features for image caption generation
    Chao Zeng
    Sam Kwong
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 2059 - 2070
  • [40] Facial Expression Recognition Through Cross-Modality Attention Fusion
    Ni, Rongrong
    Yang, Biao
    Zhou, Xu
    Cangelosi, Angelo
    Liu, Xiaofeng
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (01) : 175 - 185