Super-Resolution for Hyperspectral Remote Sensing Images Based on the 3D Attention-SRGAN Network

被引:30
|
作者
Dou, Xinyu [1 ]
Li, Chenyu [1 ]
Shi, Qian [1 ]
Liu, Mengxi [1 ]
机构
[1] Sun Yat Sen Univ, Sch Geog & Planning, Guangdong Key Lab Urbanizat & Geoslimulat, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
hyperspectral image; 3D convolution; generative adversarial networks; super-resolution; spectral angle;
D O I
10.3390/rs12071204
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Hyperspectral remote sensing images (HSIs) have a higher spectral resolution compared to multispectral remote sensing images, providing the possibility for more reasonable and effective analysis and processing of spectral data. However, rich spectral information usually comes at the expense of low spatial resolution owing to the physical limitations of sensors, which brings difficulties for identifying and analyzing targets in HSIs. In the super-resolution (SR) field, many methods have been focusing on the restoration of the spatial information while ignoring the spectral aspect. To better restore the spectral information in the HSI SR field, a novel super-resolution (SR) method was proposed in this study. Firstly, we innovatively used three-dimensional (3D) convolution based on SRGAN (Super-Resolution Generative Adversarial Network) structure to not only exploit the spatial features but also preserve spectral properties in the process of SR. Moreover, we used the attention mechanism to deal with the multiply features from the 3D convolution layers, and we enhanced the output of our model by improving the content of the generator's loss function. The experimental results indicate that the 3DASRGAN (3D Attention-based Super-Resolution Generative Adversarial Network) is both visually quantitatively better than the comparison methods, which proves that the 3DASRGAN model can reconstruct high-resolution HSIs with high efficiency.
引用
收藏
页数:26
相关论文
共 50 条
  • [41] Hyperspectral Image Super-Resolution Based on Multiscale Mixed Attention Network Fusion
    Hu, Jianwen
    Tang, Yuan
    Liu, Yaoting
    Fan, Shaosheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [42] Hybrid Attention-Based U-Shaped Network for Remote Sensing Image Super-Resolution
    Wang, Jiarui
    Wang, Binglu
    Wang, Xiaoxu
    Zhao, Yongqiang
    Long, Teng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [43] Lightweight remote sensing super-resolution with multi-scale graph attention network
    Wang, Yu
    Shao, Zhenfeng
    Lu, Tao
    Huang, Xiao
    Wang, Jiaming
    Zhang, Zhizheng
    Zuo, Xiaolong
    PATTERN RECOGNITION, 2025, 160
  • [44] CNN-Based Super-Resolution of Hyperspectral Images
    Arun, P. V.
    Buddhiraju, Krishna Mohan
    Porwal, Alok
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (09): : 6106 - 6121
  • [45] Brain MR Image Super-resolution using 3D Feature Attention Network
    Wang, Lulu
    Du, Jinglong
    Zhu, Huazheng
    He, Zhongshi
    Jia, Yuanyuan
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 1151 - 1155
  • [46] Multi-frame super-resolution of remote sensing images using attention-based GAN models
    Wang, Peijuan
    Sertel, Elif
    KNOWLEDGE-BASED SYSTEMS, 2023, 266
  • [47] NARROW ROAD EXTRACTION FROM REMOTE SENSING IMAGES BASED ON SUPER-RESOLUTION CONVOLUTIONAL NEURAL NETWORK
    Zhou, Xinyu
    Chen, Xi
    Zhang, Ye
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 685 - 688
  • [48] A Super-resolution Reconstruction Method for Remote Sensing Images Based on Adam Optimized Depth Convolution Network
    Jia, Yanqin
    2019 INTERNATIONAL CONFERENCE ON OPTICAL INSTRUMENTS AND TECHNOLOGY: OPTOELECTRONIC IMAGING/SPECTROSCOPY AND SIGNAL PROCESSING TECHNOLOGY, 2020, 11438
  • [49] SUPER-RESOLUTION RESEARCH ON REMOTE SENSING IMAGES IN THE MEGACITY BASED ON IMPROVED SRGANLiang
    Xin, Liang
    Li, Zhipeng
    Wang, Sijian
    XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 5-3 : 603 - 609
  • [50] The Use of a Stable Super-Resolution Generative Adversarial Network (SSRGAN) on Remote Sensing Images
    Pang, Boyu
    Zhao, Siwei
    Liu, Yinnian
    REMOTE SENSING, 2023, 15 (20)