Multi-scale Super-Resolution Magnetic Resonance Spectroscopic Imaging with Adjustable Sharpness

被引:5
|
作者
Dong, Siyuan [1 ]
Hangel, Gilbert [2 ]
Bogner, Wolfgang [2 ]
Widhalm, Georg [3 ]
Roessler, Karl [3 ]
Trattnig, Siegfried [2 ]
You, Chenyu [1 ]
de Graaf, Robin [4 ]
Onofrey, John A. [4 ]
Duncan, James S. [1 ,4 ]
机构
[1] Yale Univ, Elect Engn, New Haven, CT 06520 USA
[2] Med Univ Vienna, Biomed Imaging & Image Guided Therapy, Highfield MR Ctr, Vienna, Austria
[3] Med Univ Vienna, Neurosurg, Vienna, Austria
[4] Yale Univ, Radiol & Biomed Imaging, New Haven, CT USA
关键词
Brain MRSI; Super-resolution; Network conditioning; NETWORK;
D O I
10.1007/978-3-031-16446-0_39
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Magnetic Resonance Spectroscopic Imaging (MRSI) is a valuable tool for studying metabolic activities in the human body, but the current applications are limited to low spatial resolutions. The existing deep learning-based MRSI super-resolution methods require training a separate network for each upscaling factor, which is time-consuming and memory inefficient. We tackle this multi-scale super-resolution problem using a Filter Scaling strategy that modulates the convolution filters based on the upscaling factor, such that a single network can be used for various upscaling factors. Observing that each metabolite has distinct spatial characteristics, we also modulate the network based on the specific metabolite. Furthermore, our network is conditioned on the weight of adversarial loss so that the perceptual sharpness of the super-resolved metabolic maps can be adjusted within a single network. We incorporate these network conditionings using a novel MultiConditional Module. The experiments were carried out on a H-1-MRSI dataset from 15 high-grade glioma patients. Results indicate that the proposed network achieves the best performance among several multiscale super-resolution methods and can provide super-resolved metabolic maps with adjustable sharpness. Our code is available at https://github. com/dsy199610/Multiscale-SR-MRSI-adjustable-sharpness.
引用
收藏
页码:410 / 420
页数:11
相关论文
共 50 条
  • [1] A multi-scale channel attention network with federated learning for magnetic resonance image super-resolution
    Liu, Feiqiang
    Jiang, Aiwen
    Chen, Lihui
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [2] Super-resolution based on multi-scale feature aggregation adversarial networks Multi-Scale Super-Resolution with Adversarial Networks
    Song, Wei
    Li, Shuo
    Liao, Bin
    Ning, Keqing
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CRYPTOGRAPHY, NETWORK SECURITY AND COMMUNICATION TECHNOLOGY, CNSCT 2024, 2024, : 356 - 360
  • [3] Super-resolution in magnetic resonance imaging: A review
    Van Reeth, Eric
    Tham, Ivan W. K.
    Tan, Cher Heng
    Poh, Chueh Loo
    CONCEPTS IN MAGNETIC RESONANCE PART A, 2012, 40A (06) : 306 - 325
  • [4] Multi-scale adaptive weighted network for polarization computational imaging super-resolution
    Guoming Xu
    Jie Wang
    Lei Zhang
    Jian Ma
    Yong Wang
    Jiaqing Liu
    Applied Physics B, 2022, 128
  • [5] Multi-scale adaptive weighted network for polarization computational imaging super-resolution
    Xu, Guoming
    Wang, Jie
    Zhang, Lei
    Ma, Jian
    Wang, Yong
    Liu, Jiaqing
    APPLIED PHYSICS B-LASERS AND OPTICS, 2022, 128 (11):
  • [6] SHALLOW MULTI-SCALE NETWORK FOR STYLIZED SUPER-RESOLUTION
    Durand, Thibault
    Rabin, Julien
    Tschumperle, David
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2758 - 2762
  • [7] Multi-scale attention network for image super-resolution
    Wang, Li
    Shen, Jie
    Tang, E.
    Zheng, Shengnan
    Xu, Lizhong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 80
  • [8] Multi-scale Super-resolution Reconstruction of a Single Image
    Liu, Jing
    Xue, Yuxin
    He, Shuai
    Zhang, Xiaoyan
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [9] Multi-scale Dictionary for Single Image Super-resolution
    Zhang, Kaibing
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 1114 - 1121
  • [10] Multi-scale Residual Network for Image Super-Resolution
    Li, Juncheng
    Fang, Faming
    Mei, Kangfu
    Zhang, Guixu
    COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 527 - 542