3D CROSS-SCALE FEATURE TRANSFORMER NETWORK FOR BRAIN MR IMAGE SUPER-RESOLUTION

被引:4
|
作者
Zhang, Wanqi [1 ]
Wang, Lulu [1 ]
Chen, Wei [1 ]
Jia, Yuanyuan [2 ]
He, Zhongshi [1 ]
Du, Jinglong [2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing, Peoples R China
[2] Chongqing Med Univ, Coll Med Informat, Chongqing, Peoples R China
关键词
Magnetic resonance image; Cross-scale self-similarity; Super-resolution; Attention mechanism;
D O I
10.1109/ICASSP43922.2022.9746092
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
High-resolution (HR) magnetic resonance (MR) images could provide reliable visual information for clinical diagnosis. Recently, super-resolution (SR) methods based on convolutional neural networks (CNNs) have shown great potential in obtaining HR MR images. However, most existing CNN-based SR methods neglect the internal priors of the MR image, which hides the performance of SR. In this work, we propose a 3D cross-scale feature transformer network (CFTN) to utilize the cross-scale priors within MR features. Specifically, we stack multiple 3D residual channel attention blocks (RCABs) as the backbone. Meanwhile, we design a plug-in mutual-projection feature enhancement module (MFEM) to extract the target-scale features with HR cues, which is able to capture the global cross-scale self-similarity within features and can be flexibly inserted into any position of the backbone. Furthermore, we propose a spatial attention fusion module (SAFM) to adaptively adjust and fuse the target-scale features and upsampled features that are respectively extracted by the MFEM and the backbone. Experimental results show that our CFTN achieves a new state-of-the-art MR image SR performance.
引用
收藏
页码:1356 / 1360
页数:5
相关论文
共 50 条
  • [21] Cross-Modality Reference and Feature Mutual-Projection for 3D Brain MRI Image Super-Resolution
    Wang, Lulu
    Zhang, Wanqi
    Chen, Wei
    He, Zhongshi
    Jia, Yuanyuan
    Du, Jinglong
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2024, 37 (06): : 2838 - 2851
  • [22] Cross-Scale Dynamic Alignment Network for Reference-Based Super-Resolution
    Hu, Kai
    Chen, Ran
    Zhao, Zhong-Qiu
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT II, 2023, 14087 : 98 - 108
  • [23] 3D dense convolutional neural network for fast and accurate single MR image super-resolution
    Wang, Lulu
    Du, Jinglong
    Gholipour, Ali
    Zhu, Huazheng
    He, Zhongshi
    Jia, Yuanyuan
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2021, 93
  • [24] Cross-MPI: Cross-scale Stereo for Image Super-Resolution using Multiplane Images
    Zhou, Yuemei
    Wu, Gaochang
    Fu, Ying
    Li, Kun
    Liu, Yebin
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14837 - 14846
  • [25] Multi-scale feature aggregation network for Image super-resolution
    Wenlong Chen
    Pengcheng Yao
    Shaoyan Gai
    Feipeng Da
    Applied Intelligence, 2022, 52 : 3577 - 3586
  • [26] Multi-scale feature aggregation network for Image super-resolution
    Chen, Wenlong
    Yao, Pengcheng
    Gai, Shaoyan
    Da, Feipeng
    APPLIED INTELLIGENCE, 2022, 52 (04) : 3577 - 3586
  • [27] Super-resolution of 3D MR images and its application to brain segmentation
    Iwamoto, Yutaro
    Han, Xian-Hua
    Shiino, Akihiko
    Chen, Yen-Wei
    2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 838 - 841
  • [28] GATING FEATURE DENSE NETWORK FOR SINGLE ANISOTROPIC MR IMAGE SUPER-RESOLUTION
    He, Weidong
    Hu, Yangjinan
    Wang, Lulu
    He, Zhongshi
    Du, Jinglong
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1670 - 1674
  • [29] Residual Geometric Feature Transform Network for 3D Surface Super-Resolution
    Cui, Maolin
    Xie, Wuyuan
    Wang, Miaohui
    Huang, Tengcong
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 859 - 868
  • [30] Cross-Modality High-Frequency Transformer for MR Image Super-Resolution
    Fang, Chaowei
    Zhang, Dingwen
    Wang, Liang
    Zhang, Yulun
    Cheng, Lechao
    Han, Junwei
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1584 - 1592