Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet Domain

被引:100
|
作者
You, Senrong [1 ,2 ]
Lei, Baiying [3 ]
Wang, Shuqiang [1 ]
Chui, Charles K. [4 ,5 ]
Cheung, Albert C. [6 ]
Liu, Yong [7 ]
Gan, Min [8 ]
Wu, Guocheng [9 ]
Shen, Yanyan [1 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100864, Peoples R China
[3] Shenzhen Univ, Sch Biomed Engn, Shenzhen 518060, Peoples R China
[4] Hong Kong Baptist Univ, Dept Math, Hong Kong, Peoples R China
[5] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[6] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[7] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing 100872, Peoples R China
[8] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
[9] Neijiang Normal Univ, Coll Math & Informat Sci, Data Recovery Key Lab Sichuan Prov, Neijiang 641100, Peoples R China
关键词
Wavelet domain; Magnetic resonance imaging; Generative adversarial networks; Task analysis; Image reconstruction; Hafnium; Discrete wavelet transforms; Discrete wavelet transformation; generative adversarial network (GAN); magnetic resonance (MR) imaging; super-resolution (SR); textures enhance; CONVOLUTIONAL NETWORK;
D O I
10.1109/TNNLS.2022.3153088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic resonance (MR) imaging plays an important role in clinical and brain exploration. However, limited by factors such as imaging hardware, scanning time, and cost, it is challenging to acquire high-resolution MR images clinically. In this article, fine perceptive generative adversarial networks (FP-GANs) are proposed to produce super-resolution (SR) MR images from the low-resolution counterparts. By adopting the divide-and-conquer scheme, FP-GANs are designed to deal with the low-frequency (LF) and high-frequency (HF) components of MR images separately and parallelly. Specifically, FP-GANs first decompose an MR image into LF global approximation and HF anatomical texture subbands in the wavelet domain. Then, each subband generative adversarial network (GAN) simultaneously concentrates on super-resolving the corresponding subband image. In generator, multiple residual-in-residual dense blocks are introduced for better feature extraction. In addition, the texture-enhancing module is designed to trade off the weight between global topology and detailed textures. Finally, the reconstruction of the whole image is considered by integrating inverse discrete wavelet transformation in FP-GANs. Comprehensive experiments on the MultiRes_7T and ADNI datasets demonstrate that the proposed model achieves finer structure recovery and outperforms the competing methods quantitatively and qualitatively. Moreover, FP-GANs further show the value by applying the SR results in classification tasks.
引用
收藏
页码:8802 / 8814
页数:13
相关论文
共 50 条
  • [41] SUPER-RESOLUTION RECONSTRUCTION OF MR IMAGE SEQUENCES WITH CONTRAST MODELING
    Haldar, Justin P.
    Hernando, Diego
    Liang, Zhi-Pei
    2009 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1 AND 2, 2009, : 266 - 269
  • [42] Channel Splitting Network for Single MR Image Super-Resolution
    Zhao, Xiaole
    Zhang, Yulun
    Zhang, Tao
    Zou, Xueming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5649 - 5662
  • [43] DEEP MR IMAGE SUPER-RESOLUTION USING STRUCTURAL PRIORS
    Cherukuri, Venkateswararao
    Guo, Tiantong
    Schiff, Steven J.
    Monga, Vishal
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 410 - 414
  • [44] Dense channel splitting network for MR image super-resolution
    He, Yu
    Tang, Fangfang
    Jin, Jin
    Li, Mingyan
    Zhang, Hua
    Liu, Feng
    MAGNETIC RESONANCE IMAGING, 2022, 88 : 53 - 61
  • [45] Brain MR Image Super-resolution using 3D Feature Attention Network
    Wang, Lulu
    Du, Jinglong
    Zhu, Huazheng
    He, Zhongshi
    Jia, Yuanyuan
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 1151 - 1155
  • [46] Forest Single-Frame Remote Sensing Image Super-Resolution Using GANs
    Zhao, Yafeng
    Zhang, Shuai
    Hu, Junfeng
    FORESTS, 2023, 14 (11):
  • [47] Hyperspectral Image Super-Resolution with RGB Image Super-Resolution as an Auxiliary Task
    Li, Ke
    Dai, Dengxin
    van Gool, Luc
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 4039 - 4048
  • [48] Remote Sensing Image Super-Resolution via Saliency-Guided Feedback GANs
    Wu, Hanlin
    Zhang, Libao
    Ma, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [49] A novel image super-resolution reconstruction algorithm based on improved GANs and gradient penalty
    Liu, Shuangshuang
    Li, Xiaoling
    INTERNATIONAL JOURNAL OF INTELLIGENT COMPUTING AND CYBERNETICS, 2019, 12 (03) : 400 - 413
  • [50] Balanced distortion and perception in single-image super-resolution based on optimal transport in wavelet domain
    Xiao, Jun
    Liu, Tianshan
    Zhao, Rui
    Lam, Kin-Man
    NEUROCOMPUTING, 2021, 464 : 408 - 420