Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet Domain

被引:100
|
作者
You, Senrong [1 ,2 ]
Lei, Baiying [3 ]
Wang, Shuqiang [1 ]
Chui, Charles K. [4 ,5 ]
Cheung, Albert C. [6 ]
Liu, Yong [7 ]
Gan, Min [8 ]
Wu, Guocheng [9 ]
Shen, Yanyan [1 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100864, Peoples R China
[3] Shenzhen Univ, Sch Biomed Engn, Shenzhen 518060, Peoples R China
[4] Hong Kong Baptist Univ, Dept Math, Hong Kong, Peoples R China
[5] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[6] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[7] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing 100872, Peoples R China
[8] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
[9] Neijiang Normal Univ, Coll Math & Informat Sci, Data Recovery Key Lab Sichuan Prov, Neijiang 641100, Peoples R China
关键词
Wavelet domain; Magnetic resonance imaging; Generative adversarial networks; Task analysis; Image reconstruction; Hafnium; Discrete wavelet transforms; Discrete wavelet transformation; generative adversarial network (GAN); magnetic resonance (MR) imaging; super-resolution (SR); textures enhance; CONVOLUTIONAL NETWORK;
D O I
10.1109/TNNLS.2022.3153088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic resonance (MR) imaging plays an important role in clinical and brain exploration. However, limited by factors such as imaging hardware, scanning time, and cost, it is challenging to acquire high-resolution MR images clinically. In this article, fine perceptive generative adversarial networks (FP-GANs) are proposed to produce super-resolution (SR) MR images from the low-resolution counterparts. By adopting the divide-and-conquer scheme, FP-GANs are designed to deal with the low-frequency (LF) and high-frequency (HF) components of MR images separately and parallelly. Specifically, FP-GANs first decompose an MR image into LF global approximation and HF anatomical texture subbands in the wavelet domain. Then, each subband generative adversarial network (GAN) simultaneously concentrates on super-resolving the corresponding subband image. In generator, multiple residual-in-residual dense blocks are introduced for better feature extraction. In addition, the texture-enhancing module is designed to trade off the weight between global topology and detailed textures. Finally, the reconstruction of the whole image is considered by integrating inverse discrete wavelet transformation in FP-GANs. Comprehensive experiments on the MultiRes_7T and ADNI datasets demonstrate that the proposed model achieves finer structure recovery and outperforms the competing methods quantitatively and qualitatively. Moreover, FP-GANs further show the value by applying the SR results in classification tasks.
引用
收藏
页码:8802 / 8814
页数:13
相关论文
共 50 条
  • [11] Deep Wavelet Prediction for Image Super-resolution
    Guo, Tiantong
    Mousavi, Hojjat Seyed
    Vu, Tiep Huu
    Monga, Vishal
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1100 - 1109
  • [12] Coupled dictionary learning in wavelet domain for Single-Image Super-Resolution
    Junaid Ahmed
    Muhammad Waqas
    Shamshad Ali
    Raheel Ahmed Memon
    Reinhard Klette
    Signal, Image and Video Processing, 2018, 12 : 453 - 461
  • [13] Coupled dictionary learning in wavelet domain for Single-Image Super-Resolution
    Ahmed, Junaid
    Waqas, Muhammad
    Ali, Shamshad
    Memon, Raheel Ahmed
    Klette, Reinhard
    SIGNAL IMAGE AND VIDEO PROCESSING, 2018, 12 (03) : 453 - 461
  • [14] Wavelet domain image super-resolution reconstruction based on image pyramid and cycle-spinning
    Liu, H. C.
    Feng, Y.
    Sun, G. Y.
    4TH INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION SCIENCE AND TECHNOLOGY (ISIST' 2006), 2006, 48 : 417 - 421
  • [15] Best-Buddy GANs for Highly Detailed Image Super-resolution
    Li, Wenbo
    Zhou, Kun
    Qi, Lu
    Lu, Liying
    Lu, Jiangbo
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1412 - 1420
  • [16] RESIDUAL ATTENTION NETWORK FOR WAVELET DOMAIN SUPER-RESOLUTION
    Liu, Jing
    Xie, Yuan
    Song, Haichuan
    Yuan, Wang
    Ma, Lizhuang
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2033 - 2037
  • [17] CNNs in the Frequency Domain for Image Super-resolution
    Liu, Yingnan
    Paffenroth, Randy Clinton
    2019 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2019, 11321
  • [18] Selective Frequency Decomposition in the Wavelet Domain for Single Image-Based Super-Resolution
    Kim, Seonyung
    Kim, Donggyun
    Kim, Tae-Chan
    Hayes, Monson
    Paik, Joonki
    2012 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2012, : 124 - +
  • [19] DWA: Differential Wavelet Amplifier for Image Super-Resolution
    Moser, Brian B.
    Frolov, Stanislav
    Raue, Federico
    Palacio, Sebastian
    Dengel, Andreas
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT II, 2023, 14255 : 232 - 243
  • [20] Using MR Physics for Domain Generalisation and Super-Resolution
    Borges, Pedro
    Fernandez, Virginia
    Tudosiu, Petru Daniel
    Nachev, Parashkev
    Ourselin, Sebastien
    Cardoso, M. Jorge
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2024, 2025, 15187 : 177 - 186