Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet Domain

被引:100
|
作者
You, Senrong [1 ,2 ]
Lei, Baiying [3 ]
Wang, Shuqiang [1 ]
Chui, Charles K. [4 ,5 ]
Cheung, Albert C. [6 ]
Liu, Yong [7 ]
Gan, Min [8 ]
Wu, Guocheng [9 ]
Shen, Yanyan [1 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100864, Peoples R China
[3] Shenzhen Univ, Sch Biomed Engn, Shenzhen 518060, Peoples R China
[4] Hong Kong Baptist Univ, Dept Math, Hong Kong, Peoples R China
[5] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[6] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[7] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing 100872, Peoples R China
[8] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
[9] Neijiang Normal Univ, Coll Math & Informat Sci, Data Recovery Key Lab Sichuan Prov, Neijiang 641100, Peoples R China
关键词
Wavelet domain; Magnetic resonance imaging; Generative adversarial networks; Task analysis; Image reconstruction; Hafnium; Discrete wavelet transforms; Discrete wavelet transformation; generative adversarial network (GAN); magnetic resonance (MR) imaging; super-resolution (SR); textures enhance; CONVOLUTIONAL NETWORK;
D O I
10.1109/TNNLS.2022.3153088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic resonance (MR) imaging plays an important role in clinical and brain exploration. However, limited by factors such as imaging hardware, scanning time, and cost, it is challenging to acquire high-resolution MR images clinically. In this article, fine perceptive generative adversarial networks (FP-GANs) are proposed to produce super-resolution (SR) MR images from the low-resolution counterparts. By adopting the divide-and-conquer scheme, FP-GANs are designed to deal with the low-frequency (LF) and high-frequency (HF) components of MR images separately and parallelly. Specifically, FP-GANs first decompose an MR image into LF global approximation and HF anatomical texture subbands in the wavelet domain. Then, each subband generative adversarial network (GAN) simultaneously concentrates on super-resolving the corresponding subband image. In generator, multiple residual-in-residual dense blocks are introduced for better feature extraction. In addition, the texture-enhancing module is designed to trade off the weight between global topology and detailed textures. Finally, the reconstruction of the whole image is considered by integrating inverse discrete wavelet transformation in FP-GANs. Comprehensive experiments on the MultiRes_7T and ADNI datasets demonstrate that the proposed model achieves finer structure recovery and outperforms the competing methods quantitatively and qualitatively. Moreover, FP-GANs further show the value by applying the SR results in classification tasks.
引用
收藏
页码:8802 / 8814
页数:13
相关论文
共 50 条
  • [31] Deep ResNet Based Remote Sensing Image Super-Resolution Reconstruction in Discrete Wavelet Domain
    Q. Qin
    J. Dou
    Z. Tu
    Pattern Recognition and Image Analysis, 2020, 30 : 541 - 550
  • [32] A New Hybrid Brain MR Image Segmentation Algorithm With Super-Resolution, Spatial Constraint-Based Clustering and Fine Tuning
    Xia, Jing
    Li, Xuemei
    Chen, Guoning
    Zhang, Caiming
    IEEE ACCESS, 2020, 8 : 135897 - 135911
  • [33] A Fast Domain Adaptation Network for Image Super-Resolution
    Zhou, Hongyang
    Han, Zheng
    Zheng, Wenli
    Chen, Yifan
    Li, Fenghai
    IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 218 - 229
  • [34] Domain Transfer Learning for Hyperspectral Image Super-Resolution
    Li, Xiaoyan
    Zhang, Lefei
    You, Jane
    REMOTE SENSING, 2019, 11 (06)
  • [35] Image super-resolution based on multifractals in transfer domain
    Yao, Xunxiang
    Wub, Qiang
    Zhange, Peng
    Baod, Fangxun
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2025, 133
  • [36] Image Super-Resolution Based Wavelet Framework with Gradient Prior
    Xu, Yan
    Li, Xueming
    Suen, Chingyi
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS: 14TH INTERNATIONAL CONFERENCE, CAIP 2011, PT 2, 2011, 6855 : 421 - 428
  • [37] Reduced-Reference Image Quality Assessment for Single-Image Super-Resolution Based on Wavelet Domain
    Hui, Qian
    Sheng, Yuxia
    Yang, Liangkang
    Li, Qingmin
    Chai, Li
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 2067 - 2071
  • [38] Wavelet detail perception network for single image super-resolution
    Hsu, Wei-Yen
    Jian, Pei-Wen
    PATTERN RECOGNITION LETTERS, 2023, 166 : 16 - 23
  • [39] Lightweight Wavelet-Based Transformer for Image Super-Resolution
    Ran, Jinye
    Zhang, Zili
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 368 - 382
  • [40] Brain MRI Scans Super-Resolution with Wavelet and Attention Mechanisms
    Saoudi, Rania
    Boudechiche, Djameleddine
    Messali, Zoubeida
    PROGRAM OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND AUTOMATIC CONTROL, ICEEAC 2024, 2024,