Cross-modality Attention Method for Medical Image Enhancement

被引:0
|
作者
Hu, Zebin [1 ]
Liu, Hao [1 ,2 ]
Li, Zhendong [1 ,2 ]
Yu, Zekuan [3 ]
机构
[1] Ningxia Univ, Sch Informat Engn, Yinchuan 750021, Ningxia, Peoples R China
[2] Collaborat Innovat Ctr Ningxia Big Data & Artific, Yinchuan 750021, Ningxia, Peoples R China
[3] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
基金
美国国家科学基金会;
关键词
Cross-modality learning; Generative adversarial model; Self-attention; Medical imaging; MRI;
D O I
10.1007/978-3-030-88010-1_34
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a cross-modality attention method (CMAM) for medical image enhancement especially in magnetic resonance imaging, which typically addresses the issue of exploiting the clean feature by generative model. To realize this goal, we distill the complementary information directly from different modalities of raw input images for reliable image generation. More specifically, our method integrates local features with exploiting the semantic high-order dependencies and thus explores attentional fields for robust feature representation learning. To evaluate the effectiveness of our CMAM, we conduct folds of experiments on the standard benchmark Brats 2019 dataset and experimental results demonstrate the effectiveness of CMAM.
引用
收藏
页码:411 / 423
页数:13
相关论文
共 50 条
  • [41] Cross-modality interactive attention network for multispectral pedestrian detection
    Zhang, Lu
    Liu, Zhiyong
    Zhang, Shifeng
    Yang, Xu
    Qiao, Hong
    Huang, Kaizhu
    Hussain, Amir
    INFORMATION FUSION, 2019, 50 : 20 - 29
  • [42] Two-Stream Video Classification with Cross-Modality Attention
    Chi, Lu
    Tian, Guiyu
    Mu, Yadong
    Tian, Qi
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 4511 - 4520
  • [43] CROSS-MODALITY MATCHING
    AUERBACH, C
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1973, 25 (NOV): : 492 - 495
  • [44] Adapted nnU-Net: A Robust Baseline for Cross-Modality Synthesis and Medical Image Inpainting
    Longuefosse, Arthur
    Le Bot, Edern
    De Senneville, Baudouin Denis
    Giraud, Remi
    Mansencal, Boris
    Coupe, Pierrick
    Desbarats, Pascal
    Baldacci, Fabien
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2024, 2025, 15187 : 24 - 33
  • [45] Mutual Information Guided Diffusion for Zero-Shot Cross-Modality Medical Image Translation
    Wang, Zihao
    Yang, Yingyu
    Chen, Yuzhou
    Yuan, Tingting
    Sermesant, Maxime
    Delingette, Herve
    Wu, Ona
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (08) : 2825 - 2838
  • [46] Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation
    Chen, Cheng
    Dou, Qi
    Chen, Hao
    Qin, Jing
    Heng, Pheng Ann
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (07) : 2494 - 2505
  • [47] Cyclic Cross-Modality Interaction for Hyperspectral and Multispectral Image Fusion
    Chen, Shi
    Zhang, Lefei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 741 - 753
  • [48] LOCAL CROSS-MODALITY IMAGE ALIGNMENT USING UNSUPERVISED LEARNING
    BERNANDER, O
    KOCH, C
    LECTURE NOTES IN COMPUTER SCIENCE, 1990, 427 : 573 - 575
  • [49] Disentangle domain features for cross-modality cardiac image segmentation
    Pei, Chenhao
    Wu, Fuping
    Huang, Liqin
    Zhuang, Xiahai
    Medical Image Analysis, 2021, 71
  • [50] Fine-grained deepfake detection based on cross-modality attention
    Zhao, Lei
    Zhang, Mingcheng
    Ding, Hongwei
    Cui, Xiaohui
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (15): : 10861 - 10874