Super-Resolution for Hyperspectral Remote Sensing Images Based on the 3D Attention-SRGAN Network

被引:30
|
作者
Dou, Xinyu [1 ]
Li, Chenyu [1 ]
Shi, Qian [1 ]
Liu, Mengxi [1 ]
机构
[1] Sun Yat Sen Univ, Sch Geog & Planning, Guangdong Key Lab Urbanizat & Geoslimulat, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
hyperspectral image; 3D convolution; generative adversarial networks; super-resolution; spectral angle;
D O I
10.3390/rs12071204
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Hyperspectral remote sensing images (HSIs) have a higher spectral resolution compared to multispectral remote sensing images, providing the possibility for more reasonable and effective analysis and processing of spectral data. However, rich spectral information usually comes at the expense of low spatial resolution owing to the physical limitations of sensors, which brings difficulties for identifying and analyzing targets in HSIs. In the super-resolution (SR) field, many methods have been focusing on the restoration of the spatial information while ignoring the spectral aspect. To better restore the spectral information in the HSI SR field, a novel super-resolution (SR) method was proposed in this study. Firstly, we innovatively used three-dimensional (3D) convolution based on SRGAN (Super-Resolution Generative Adversarial Network) structure to not only exploit the spatial features but also preserve spectral properties in the process of SR. Moreover, we used the attention mechanism to deal with the multiply features from the 3D convolution layers, and we enhanced the output of our model by improving the content of the generator's loss function. The experimental results indicate that the 3DASRGAN (3D Attention-based Super-Resolution Generative Adversarial Network) is both visually quantitatively better than the comparison methods, which proves that the 3DASRGAN model can reconstruct high-resolution HSIs with high efficiency.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] Super-resolution Restoration of Remote-sensing Images
    刘扬阳
    金伟其
    苏秉华
    陈华
    张楠
    Journal of China Ordnance, 2006, (01) : 43 - 46
  • [32] A Lightweight Feature Distillation and Enhancement Network for Super-Resolution Remote Sensing Images
    Gao, Feng
    Li, Liangliang
    Wang, Jiawen
    Sun, Kaipeng
    Lv, Ming
    Jia, Zhenhong
    Ma, Hongbing
    SENSORS, 2023, 23 (08)
  • [33] Multi-scale hybrid attention graph convolution neural network for remote sensing images super-resolution
    Liang, Guojun
    Kintak, U.
    Yin, Haichang
    Liu, Jin
    Luo, Huibin
    SIGNAL PROCESSING, 2023, 207
  • [34] Lightweight Feedback Convolution Neural Network for Remote Sensing Images Super-Resolution
    Wang, Jin
    Wu, Yiming
    Wang, Liu
    Wang, Lei
    Alfarraj, Osama
    Tolba, Amr
    IEEE ACCESS, 2021, 9 : 15992 - 16003
  • [35] DBSAGAN: Dual Branch Split Attention Generative Adversarial Network for Super-Resolution Reconstruction in Remote Sensing Images
    Song, Yu
    Li, Jianwei
    Hu, Zhongzheng
    Cheng, Liangxiao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [36] Mixed 2D/3D Convolutional Network for Hyperspectral Image Super-Resolution
    Li, Qiang
    Wang, Qi
    Li, Xuelong
    REMOTE SENSING, 2020, 12 (10)
  • [37] Remote Sensing Image Super-Resolution via Dual-Resolution Network Based on Connected Attention Mechanism
    Zhang, Xiangrong
    Li, Zhenyu
    Zhang, Tianyang
    Liu, Fengsheng
    Tang, Xu
    Chen, Puhua
    Jiao, Licheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [38] A Comparison of Neural Network-Based Super-Resolution Models on 3D Rendered Images
    Berral-Soler, Rafael
    Madrid-Cuevas, Francisco J.
    Ventura, Sebastian
    Munoz-Salinas, Rafael
    Marin-Jimenez, Manuel J.
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2023, PT I, 2023, 14184 : 45 - 55
  • [39] A Joint Super-Resolution and Deformable Registration Network for 3D Brain Images
    Lan, Sheng
    Guo, Zhenhua
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 173 - 179
  • [40] Unified Framework for the Joint Super-Resolution and Registration of Multiangle Multi/Hyperspectral Remote Sensing Images
    Chen, Hang
    Zhang, Hongyan
    Du, Juan
    Luo, Bin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 2369 - 2384