Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet Domain

被引:100
|
作者
You, Senrong [1 ,2 ]
Lei, Baiying [3 ]
Wang, Shuqiang [1 ]
Chui, Charles K. [4 ,5 ]
Cheung, Albert C. [6 ]
Liu, Yong [7 ]
Gan, Min [8 ]
Wu, Guocheng [9 ]
Shen, Yanyan [1 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100864, Peoples R China
[3] Shenzhen Univ, Sch Biomed Engn, Shenzhen 518060, Peoples R China
[4] Hong Kong Baptist Univ, Dept Math, Hong Kong, Peoples R China
[5] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[6] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[7] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing 100872, Peoples R China
[8] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
[9] Neijiang Normal Univ, Coll Math & Informat Sci, Data Recovery Key Lab Sichuan Prov, Neijiang 641100, Peoples R China
关键词
Wavelet domain; Magnetic resonance imaging; Generative adversarial networks; Task analysis; Image reconstruction; Hafnium; Discrete wavelet transforms; Discrete wavelet transformation; generative adversarial network (GAN); magnetic resonance (MR) imaging; super-resolution (SR); textures enhance; CONVOLUTIONAL NETWORK;
D O I
10.1109/TNNLS.2022.3153088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic resonance (MR) imaging plays an important role in clinical and brain exploration. However, limited by factors such as imaging hardware, scanning time, and cost, it is challenging to acquire high-resolution MR images clinically. In this article, fine perceptive generative adversarial networks (FP-GANs) are proposed to produce super-resolution (SR) MR images from the low-resolution counterparts. By adopting the divide-and-conquer scheme, FP-GANs are designed to deal with the low-frequency (LF) and high-frequency (HF) components of MR images separately and parallelly. Specifically, FP-GANs first decompose an MR image into LF global approximation and HF anatomical texture subbands in the wavelet domain. Then, each subband generative adversarial network (GAN) simultaneously concentrates on super-resolving the corresponding subband image. In generator, multiple residual-in-residual dense blocks are introduced for better feature extraction. In addition, the texture-enhancing module is designed to trade off the weight between global topology and detailed textures. Finally, the reconstruction of the whole image is considered by integrating inverse discrete wavelet transformation in FP-GANs. Comprehensive experiments on the MultiRes_7T and ADNI datasets demonstrate that the proposed model achieves finer structure recovery and outperforms the competing methods quantitatively and qualitatively. Moreover, FP-GANs further show the value by applying the SR results in classification tasks.
引用
收藏
页码:8802 / 8814
页数:13
相关论文
共 50 条
  • [1] Wavelet Dual-Stream Network for Brain MR Image Super-Resolution
    Wang, Wanliang
    Xing, Fangsen
    Chen, Jiacheng
    Guan, Qiu
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [2] Image super-resolution reconstruction based on wavelet domain
    Dong Ben-zhi
    Yu Ming-cong
    Zhao Peng
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (02) : 317 - 326
  • [3] Deep Residual Network in Wavelet Domain for Image Super-resolution
    Duan L.-J.
    Wu C.-L.
    En Q.
    Qiao Y.-H.
    Zhang Y.-D.
    Chen J.-C.
    Ruan Jian Xue Bao/Journal of Software, 2019, 30 (04): : 941 - 953
  • [4] Wavelet Domain Multidictionary Learning for Single Image Super-Resolution
    Wu, Xiaomin
    Fan, Jiulun
    Xu, Jian
    Wang, Yanzi
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2015, 2015
  • [5] Single image super-resolution with denoising diffusion GANS
    Xiao, Heng
    Wang, Xin
    Wang, Jun
    Cai, Jing-Ye
    Deng, Jian-Hua
    Yan, Jing-Ke
    Tang, Yi-Dong
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [6] Single Image Super-Resolution Based on Wasserstein GANs
    Wu, Fei
    Wang, Bo
    Cui, Dagang
    Li, Linhao
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 9649 - 9653
  • [7] Generative adversarial network in wavelet domain for single image super-resolution
    Zhang, Fan
    Wang, Xinwei
    Cao, Lin
    Du, Kangning
    Guo, Yanan
    Journal of Computers (Taiwan), 2021, 32 (03) : 249 - 262
  • [8] Wavelet Domain Based Directional Dictionaries for Single Image Super-Resolution
    Ahmed, Junaid
    Gao, Bin
    Tian, Gui Yun
    2017 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2017, : 432 - 437
  • [9] Bi-GANs-ST for Perceptual Image Super-Resolution
    Luo, Xiaotong
    Chen, Rong
    Xie, Yuan
    Qu, Yanyun
    Li, Cuihua
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 20 - 34
  • [10] Enhancing Knee MR Image Clarity through Image Domain Super-Resolution Reconstruction
    Patel, Vishal
    Wang, Alan
    Monk, Andrew Paul
    Schneider, Marco Tien-Yueh
    BIOENGINEERING-BASEL, 2024, 11 (02):