3D CROSS-SCALE FEATURE TRANSFORMER NETWORK FOR BRAIN MR IMAGE SUPER-RESOLUTION

被引:4
|
作者
Zhang, Wanqi [1 ]
Wang, Lulu [1 ]
Chen, Wei [1 ]
Jia, Yuanyuan [2 ]
He, Zhongshi [1 ]
Du, Jinglong [2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing, Peoples R China
[2] Chongqing Med Univ, Coll Med Informat, Chongqing, Peoples R China
关键词
Magnetic resonance image; Cross-scale self-similarity; Super-resolution; Attention mechanism;
D O I
10.1109/ICASSP43922.2022.9746092
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
High-resolution (HR) magnetic resonance (MR) images could provide reliable visual information for clinical diagnosis. Recently, super-resolution (SR) methods based on convolutional neural networks (CNNs) have shown great potential in obtaining HR MR images. However, most existing CNN-based SR methods neglect the internal priors of the MR image, which hides the performance of SR. In this work, we propose a 3D cross-scale feature transformer network (CFTN) to utilize the cross-scale priors within MR features. Specifically, we stack multiple 3D residual channel attention blocks (RCABs) as the backbone. Meanwhile, we design a plug-in mutual-projection feature enhancement module (MFEM) to extract the target-scale features with HR cues, which is able to capture the global cross-scale self-similarity within features and can be flexibly inserted into any position of the backbone. Furthermore, we propose a spatial attention fusion module (SAFM) to adaptively adjust and fuse the target-scale features and upsampled features that are respectively extracted by the MFEM and the backbone. Experimental results show that our CFTN achieves a new state-of-the-art MR image SR performance.
引用
收藏
页码:1356 / 1360
页数:5
相关论文
共 50 条
  • [1] Brain MR Image Super-resolution using 3D Feature Attention Network
    Wang, Lulu
    Du, Jinglong
    Zhu, Huazheng
    He, Zhongshi
    Jia, Yuanyuan
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 1151 - 1155
  • [2] CFDN: cross-scale feature distillation network for lightweight single image super-resolution
    Mu, Zihan
    Zhu, Ge
    Tang, Jinping
    MULTIMEDIA SYSTEMS, 2024, 30 (06)
  • [3] Adjacent slices feature transformer network for single anisotropic 3D brain MRI image super-resolution
    Wang, Lulu
    Zhu, Huazheng
    He, Zhongshi
    Jia, Yuanyuan
    Du, Jinglong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 72
  • [4] Remote sensing image super-resolution via cross-scale hierarchical transformer
    Xiao, Yi
    Yuan, Qiangqiang
    He, Jiang
    Zhang, Liangpei
    GEO-SPATIAL INFORMATION SCIENCE, 2024, 27 (06) : 1914 - 1930
  • [5] Remote sensing image super-resolution via cross-scale hierarchical transformer
    Xiao, Yi
    Yuan, Qiangqiang
    He, Jiang
    Zhang, Liangpei
    GEO-SPATIAL INFORMATION SCIENCE, 2024, 27 (06) : 1914 - 1930
  • [6] CSINet: A Cross-Scale Interaction Network for Lightweight Image Super-Resolution
    Ke, Gang
    Lo, Sio-Long
    Zou, Hua
    Liu, Yi-Feng
    Chen, Zhen-Qiang
    Wang, Jing-Kai
    SENSORS, 2024, 24 (04)
  • [7] Cross Transformer Network for Scale-Arbitrary Image Super-Resolution
    He, Dehong
    Wu, Song
    Liu, Jinpeng
    Xiao, Guoqiang
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, 2022, 13369 : 633 - 644
  • [8] Hyperspectral Image Super-Resolution Network Based on Cross-Scale Nonlocal Attention
    Li, Shuangliang
    Tian, Yugang
    Wang, Cheng
    Wu, Hongxian
    Zheng, Shaolan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] Learning Multi-Modal Cross-Scale Deformable Transformer Network for Unregistered Hyperspectral Image Super-resolution
    Dong, Wenqian
    Xu, Yang
    Qu, Jiahui
    Hou, Shaoxiong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 1573 - 1581
  • [10] Lightweight brain MR image super-resolution using 3D convolution
    Young Beom Kim
    The Van Le
    Jin Young Lee
    Multimedia Tools and Applications, 2024, 83 : 8785 - 8795