Cross-modality Attention Method for Medical Image Enhancement

被引:0
|
作者
Hu, Zebin [1 ]
Liu, Hao [1 ,2 ]
Li, Zhendong [1 ,2 ]
Yu, Zekuan [3 ]
机构
[1] Ningxia Univ, Sch Informat Engn, Yinchuan 750021, Ningxia, Peoples R China
[2] Collaborat Innovat Ctr Ningxia Big Data & Artific, Yinchuan 750021, Ningxia, Peoples R China
[3] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
基金
美国国家科学基金会;
关键词
Cross-modality learning; Generative adversarial model; Self-attention; Medical imaging; MRI;
D O I
10.1007/978-3-030-88010-1_34
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a cross-modality attention method (CMAM) for medical image enhancement especially in magnetic resonance imaging, which typically addresses the issue of exploiting the clean feature by generative model. To realize this goal, we distill the complementary information directly from different modalities of raw input images for reliable image generation. More specifically, our method integrates local features with exploiting the semantic high-order dependencies and thus explores attentional fields for robust feature representation learning. To evaluate the effectiveness of our CMAM, we conduct folds of experiments on the standard benchmark Brats 2019 dataset and experimental results demonstrate the effectiveness of CMAM.
引用
收藏
页码:411 / 423
页数:13
相关论文
共 50 条
  • [21] Hybrid Fusion with Intra- and Cross-Modality Attention for Image-Recipe Retrieval
    Li, Jiao
    Xu, Xing
    Yu, Wei
    Shen, Fumin
    Cao, Zuo
    Zuo, Kai
    Shen, Heng Tao
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 244 - 254
  • [22] Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentation
    Chen, Cheng
    Dou, Qi
    Chen, Hao
    Qin, Jing
    Heng, Pheng-Ann
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 865 - 872
  • [23] Deep adaptive fusion with cross-modality feature transition and modality quaternion learning for medical image fusion
    Srivastava, Somya
    Bhatia, Shaveta
    Agrawal, Arun Prakash
    Jayswal, Anant Kumar
    Godara, Jyoti
    Dubey, Gaurav
    EVOLVING SYSTEMS, 2025, 16 (01)
  • [24] Cross-Modality Person Re-Identification Method with Joint-Modality Generation and Feature Enhancement
    Bi, Yihan
    Wang, Rong
    Zhou, Qianli
    Zeng, Zhaolong
    Lin, Ronghui
    Wang, Mingjie
    ENTROPY, 2024, 26 (08)
  • [25] Structured detail enhancement for cross-modality face synthesis
    Song, Chunwei
    Li, Feng
    Dang, Yunqi
    Gao, Huijun
    Yan, Zifei
    Zuo, Wangmeng
    NEUROCOMPUTING, 2016, 212 : 107 - 120
  • [26] Mind the Gap: Alleviating Local Imbalance for Unsupervised Cross-Modality Medical Image Segmentation
    Su, Zixian
    Yao, Kai
    Yang, Xi
    Wang, Qiufeng
    Yan, Yuyao
    Sun, Jie
    Huang, Kaizhu
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (07) : 3396 - 3407
  • [27] Target-Guided Diffusion Models for Unpaired Cross-Modality Medical Image Translation
    Luo, Yimin
    Yang, Qinyu
    Liu, Ziyi
    Shi, Zenglin
    Huang, Weimin
    Zheng, Guoyan
    Cheng, Jun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (07) : 4062 - 4071
  • [28] Quaternion Cross-Modality Spatial Learning for Multi-Modal Medical Image Segmentation
    Chen, Junyang
    Huang, Guoheng
    Yuan, Xiaochen
    Zhong, Guo
    Zheng, Zewen
    Pun, Chi-Man
    Zhu, Jian
    Huang, Zhixin
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (03) : 1412 - 1423
  • [29] Toward Computing Cross-Modality Symmetric Non-Rigid Medical Image Registration
    Mohanty, Snigdha
    Dakua, Sarada Prasad
    IEEE ACCESS, 2022, 10 : 24528 - 24539
  • [30] Generalizable Cross-modality Medical Image Segmentation via Style Augmentation and Dual Normalization
    Zhou, Ziqi
    Qi, Lei
    Yang, Xin
    Ni, Dong
    Shi, Yinghuan
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20824 - 20833