STADNet: Spatial-Temporal Attention-Guided Dual-Path Network for cardiac cine MRI super-resolution

被引:1
|
作者
Lyu, Jun [1 ]
Wang, Shuo [2 ]
Tian, Yapeng [3 ]
Zou, Jing [4 ]
Dong, Shunjie [5 ]
Wang, Chengyan [6 ]
Aviles-Rivero, Angelica I. [7 ]
Qin, Jing [4 ]
机构
[1] Yantai Univ, Sch Comp & Control Engn, Yantai, Peoples R China
[2] Fudan Univ, Sch Basic Med Sci, Shanghai, Peoples R China
[3] Univ Texas Dallas, Dept Comp Sci, Richardson, TX USA
[4] Hong Kong Polytech Univ, Ctr Smart Hlth, Sch Nursing, Hong Kong, Peoples R China
[5] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
[6] Fudan Univ, Human Phenome Inst, Shanghai, Peoples R China
[7] Univ Cambridge, Dept Appl Math & Theoret Phys, Cambridge, England
基金
中国国家自然科学基金;
关键词
Cine cardiac MRI; Super resolution; Position-weighted; Flow-enhanced; Non-local attention; RECONSTRUCTION;
D O I
10.1016/j.media.2024.103142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cardiac cine magnetic resonance imaging (MRI) is a commonly used clinical tool for evaluating cardiac function and morphology. However, its diagnostic accuracy may be compromised by the low spatial resolution. Current methods for cine MRI super-resolution reconstruction still have limitations. They typically rely on 3D convolutional neural networks or recurrent neural networks, which may not effectively capture long-range or non-local features due to their limited receptive fields. Optical flow estimators are also commonly used to align neighboring frames, which may cause information loss and inaccurate motion estimation. Additionally, pre-warping strategies may involve interpolation, leading to potential loss of texture details and complicated anatomical structures. To overcome these challenges, we propose a novel Spatial-Temporal Attention-Guided Dual-Path Network (STADNet) for cardiac cine MRI super-resolution. We utilize transformers to model longrange dependencies in cardiac cine MR images and design a cross-frame attention module in the location-aware spatial path, which enhances the spatial details of the current frame by using complementary information from neighboring frames. We also introduce a recurrent flow-enhanced attention module in the motion-aware temporal path that exploits the correlation between cine MRI frames and extracts the motion information of the heart. Experimental results demonstrate that STADNet outperforms SOTA approaches and has significant potential for clinical practice.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Video Compression Artifacts Removal With Spatial-Temporal Attention-Guided Enhancement
    Jiang, Nanfeng
    Chen, Weiling
    Lin, Jielian
    Zhao, Tiesong
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5657 - 5669
  • [32] DDet: Dual-Path Dynamic Enhancement Network for Real-World Image Super-Resolution
    Shi, Yukai
    Zhong, Haoyu
    Yang, Zhijing
    Yang, Xiaojun
    Lin, Liang
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 481 - 485
  • [33] Vessel Trajectory Prediction Based on AIS Data: Dual-Path Spatial-Temporal Attention Network with Multi-Attribute Information
    Huang, Feilong
    Liu, Zhuoran
    Li, Xiaohe
    Mou, Fangli
    Li, Pengfei
    Fan, Zide
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (11)
  • [34] Spatial-Temporal Super-Resolution Land Cover Mapping With a Local Spatial-Temporal Dependence Model
    Li, Xiaodong
    Ling, Feng
    Foody, Giles M.
    Ge, Yong
    Zhang, Yihang
    Wang, Lihui
    Shi, Lingfei
    Li, Xinyan
    Du, Yun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (07): : 4951 - 4966
  • [35] Light Field Super-resolution via Attention-Guided Fusion of Hybrid Lenses
    Jin, Jing
    Hou, Junhui
    Chen, Jie
    Kwong, Sam
    Yu, Jingyi
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 193 - 201
  • [36] Why Not Both? An Attention-Guided Transformer with Pixel-Related Deconvolution Network for Face Super-Resolution
    Zhang, Zhe
    Qi, Chun
    APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [37] Building an End-to-End Spatial-Temporal Convolutional Network for Video Super-Resolution
    Guo, Jun
    Chao, Hongyang
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 4053 - 4060
  • [38] Conditional Neural Video Coding with Spatial-Temporal Super-Resolution
    Wang, Henan
    Pan, Xiaohan
    Feng, Runsen
    Guo, Zongyu
    Chen, Zhibo
    2024 DATA COMPRESSION CONFERENCE, DCC, 2024, : 591 - 591
  • [39] CTVSR: Collaborative Spatial-Temporal Transformer for Video Super-Resolution
    Tang, Jun
    Lu, Chenyan
    Liu, Zhengxue
    Li, Jiale
    Dai, Hang
    Ding, Yong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 5018 - 5032
  • [40] Image Super-Resolution Based on Dual Path Network
    Kuang, Hailan
    Wang, Hongchuan
    Ma, Xiaolin
    Liu, Xinhua
    2018 10TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA), 2018, : 225 - 228