STADNet: Spatial-Temporal Attention-Guided Dual-Path Network for cardiac cine MRI super-resolution

被引:1
|
作者
Lyu, Jun [1 ]
Wang, Shuo [2 ]
Tian, Yapeng [3 ]
Zou, Jing [4 ]
Dong, Shunjie [5 ]
Wang, Chengyan [6 ]
Aviles-Rivero, Angelica I. [7 ]
Qin, Jing [4 ]
机构
[1] Yantai Univ, Sch Comp & Control Engn, Yantai, Peoples R China
[2] Fudan Univ, Sch Basic Med Sci, Shanghai, Peoples R China
[3] Univ Texas Dallas, Dept Comp Sci, Richardson, TX USA
[4] Hong Kong Polytech Univ, Ctr Smart Hlth, Sch Nursing, Hong Kong, Peoples R China
[5] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
[6] Fudan Univ, Human Phenome Inst, Shanghai, Peoples R China
[7] Univ Cambridge, Dept Appl Math & Theoret Phys, Cambridge, England
基金
中国国家自然科学基金;
关键词
Cine cardiac MRI; Super resolution; Position-weighted; Flow-enhanced; Non-local attention; RECONSTRUCTION;
D O I
10.1016/j.media.2024.103142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cardiac cine magnetic resonance imaging (MRI) is a commonly used clinical tool for evaluating cardiac function and morphology. However, its diagnostic accuracy may be compromised by the low spatial resolution. Current methods for cine MRI super-resolution reconstruction still have limitations. They typically rely on 3D convolutional neural networks or recurrent neural networks, which may not effectively capture long-range or non-local features due to their limited receptive fields. Optical flow estimators are also commonly used to align neighboring frames, which may cause information loss and inaccurate motion estimation. Additionally, pre-warping strategies may involve interpolation, leading to potential loss of texture details and complicated anatomical structures. To overcome these challenges, we propose a novel Spatial-Temporal Attention-Guided Dual-Path Network (STADNet) for cardiac cine MRI super-resolution. We utilize transformers to model longrange dependencies in cardiac cine MR images and design a cross-frame attention module in the location-aware spatial path, which enhances the spatial details of the current frame by using complementary information from neighboring frames. We also introduce a recurrent flow-enhanced attention module in the motion-aware temporal path that exploits the correlation between cine MRI frames and extracts the motion information of the heart. Experimental results demonstrate that STADNet outperforms SOTA approaches and has significant potential for clinical practice.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Feature Maps Need More Attention: A Spatial-Channel Mutual Attention-Guided Transformer Network for Face Super-Resolution
    Zhang, Zhe
    Qi, Chun
    APPLIED SCIENCES-BASEL, 2024, 14 (10):
  • [22] Attention-guided multi-path cross-CNN for underwater image super-resolution
    Zhang, Yan
    Yang, Shangxue
    Sun, Yemei
    Liu, Shudong
    Li, Xianguo
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (01) : 155 - 163
  • [23] Attention-guided multi-path cross-CNN for underwater image super-resolution
    Yan Zhang
    Shangxue Yang
    Yemei Sun
    Shudong Liu
    Xianguo Li
    Signal, Image and Video Processing, 2022, 16 : 155 - 163
  • [24] Spatial-temporal feature refine network for single image super-resolution
    Jiayi Qin
    Lihui Chen
    Kai Liu
    Gwanggil Jeon
    Xiaomin Yang
    Applied Intelligence, 2023, 53 : 9668 - 9688
  • [25] Spatial-temporal feature refine network for single image super-resolution
    Qin, Jiayi
    Chen, Lihui
    Liu, Kai
    Jeon, Gwanggil
    Yang, Xiaomin
    APPLIED INTELLIGENCE, 2023, 53 (08) : 9668 - 9688
  • [26] MAPANet: A Multi-Scale Attention-Guided Progressive Aggregation Network for Multi-Contrast MRI Super-Resolution
    Liu, Licheng
    Liu, Tao
    Zhou, Wei
    Wang, Yaonan
    Liu, Min
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 928 - 940
  • [27] Super-resolution reconstruction of images based on residual dual-path interactive fusion combined with attention
    Hao, Wang
    Taile, Peng
    Ying, Zhou
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (03)
  • [28] Dual-Path Adversarial Generation Network for Super-Resolution Reconstruction of Remote Sensing Images
    Ren, Zhipeng
    Zhao, Jianping
    Chen, Chunyi
    Lou, Yan
    Ma, Xiaocong
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [29] InfraFFN: A Feature Fusion Network leveraging dual-path convolution and self-attention for infrared image super-resolution
    Qin, Feiwei
    Shen, Zhengwei
    Ge, Ruiquan
    Zhang, Kai
    Lin, Fei
    Wang, Yeru
    Gorriz, Juan M.
    Elazab, Ahmed
    Wang, Changmiao
    KNOWLEDGE-BASED SYSTEMS, 2025, 310
  • [30] Attention-guided hybrid transformer-convolutional neural network for underwater image super-resolution
    Zhan, Zihan
    Li, Chaofeng
    Zhang, Yuqi
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)