Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet Domain

被引:100
|
作者
You, Senrong [1 ,2 ]
Lei, Baiying [3 ]
Wang, Shuqiang [1 ]
Chui, Charles K. [4 ,5 ]
Cheung, Albert C. [6 ]
Liu, Yong [7 ]
Gan, Min [8 ]
Wu, Guocheng [9 ]
Shen, Yanyan [1 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100864, Peoples R China
[3] Shenzhen Univ, Sch Biomed Engn, Shenzhen 518060, Peoples R China
[4] Hong Kong Baptist Univ, Dept Math, Hong Kong, Peoples R China
[5] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[6] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[7] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing 100872, Peoples R China
[8] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
[9] Neijiang Normal Univ, Coll Math & Informat Sci, Data Recovery Key Lab Sichuan Prov, Neijiang 641100, Peoples R China
关键词
Wavelet domain; Magnetic resonance imaging; Generative adversarial networks; Task analysis; Image reconstruction; Hafnium; Discrete wavelet transforms; Discrete wavelet transformation; generative adversarial network (GAN); magnetic resonance (MR) imaging; super-resolution (SR); textures enhance; CONVOLUTIONAL NETWORK;
D O I
10.1109/TNNLS.2022.3153088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic resonance (MR) imaging plays an important role in clinical and brain exploration. However, limited by factors such as imaging hardware, scanning time, and cost, it is challenging to acquire high-resolution MR images clinically. In this article, fine perceptive generative adversarial networks (FP-GANs) are proposed to produce super-resolution (SR) MR images from the low-resolution counterparts. By adopting the divide-and-conquer scheme, FP-GANs are designed to deal with the low-frequency (LF) and high-frequency (HF) components of MR images separately and parallelly. Specifically, FP-GANs first decompose an MR image into LF global approximation and HF anatomical texture subbands in the wavelet domain. Then, each subband generative adversarial network (GAN) simultaneously concentrates on super-resolving the corresponding subband image. In generator, multiple residual-in-residual dense blocks are introduced for better feature extraction. In addition, the texture-enhancing module is designed to trade off the weight between global topology and detailed textures. Finally, the reconstruction of the whole image is considered by integrating inverse discrete wavelet transformation in FP-GANs. Comprehensive experiments on the MultiRes_7T and ADNI datasets demonstrate that the proposed model achieves finer structure recovery and outperforms the competing methods quantitatively and qualitatively. Moreover, FP-GANs further show the value by applying the SR results in classification tasks.
引用
收藏
页码:8802 / 8814
页数:13
相关论文
共 50 条
  • [21] Coarse-to-Fine CNN for Image Super-Resolution
    Tian, Chunwei
    Xu, Yong
    Zuo, Wangmeng
    Zhang, Bob
    Fei, Lunke
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1489 - 1502
  • [22] Deep MR Brain Image Super-Resolution Using Spatio-Structural Priors
    Cherukuri, Venkateswararao
    Guo, Tiantong
    Schiff, Steven J.
    Monga, Vishal
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 1368 - 1383
  • [23] Lightweight brain MR image super-resolution using 3D convolution
    Young Beom Kim
    The Van Le
    Jin Young Lee
    Multimedia Tools and Applications, 2024, 83 : 8785 - 8795
  • [24] Single-image super-resolution of brain MR images using overcomplete dictionaries
    Rueda, Andrea
    Malpica, Norberto
    Romero, Eduardo
    MEDICAL IMAGE ANALYSIS, 2013, 17 (01) : 113 - 132
  • [25] Lightweight brain MR image super-resolution using 3D convolution
    Kim, Young Beom
    Van Le, The
    Lee, Jin Young
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 8785 - 8795
  • [26] Analysis of the Wavelet Domain Filtering Approach for Video Super-Resolution
    Daithankar, Mrunmayee, V
    Ruikar, Sachin D.
    ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2021, 11 (04) : 7477 - 7482
  • [27] Eigentransformation-based face super-resolution in the wavelet domain
    Hui, Zhuo
    Lam, Kin-Man
    PATTERN RECOGNITION LETTERS, 2012, 33 (06) : 718 - 727
  • [28] Deep ResNet Based Remote Sensing Image Super-Resolution Reconstruction in Discrete Wavelet Domain
    Qin, Q.
    Dou, J.
    Tu, Z.
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2020, 30 (03) : 541 - 550
  • [29] Improved Single Image Super-resolution Using Sparsity and Structured Dictionary Learning in Wavelet Domain
    Nazzal, Mahmoud
    Ozkaramanli, Huseyin
    2013 21ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2013,
  • [30] A MLP-PNN Neural Network for CCD Image Super-Resolution in Wavelet Packet Domain
    Zhao Xiuying
    Fu Deyou
    Zhai Linpei
    2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, : 12318 - +