Hyperspectral Image Super-Resolution Based on Feature Diversity Extraction

被引:2
|
作者
Zhang, Jing [1 ,2 ,3 ,4 ]
Zheng, Renjie [4 ]
Wan, Zekang [2 ]
Geng, Ruijing [5 ]
Wang, Yi [6 ]
Yang, Yu [6 ]
Zhang, Xuepeng [2 ]
Li, Yunsong [1 ,2 ]
机构
[1] Xidian Univ, State Key Lab Lntegrated Serv Network, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
[3] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510700, Peoples R China
[4] Xidian Univ, Hangzhou Inst Technol, Hangzhou 311231, Peoples R China
[5] Space Engn Univ, Sch Space Informat, Beijing 101416, Peoples R China
[6] Syst Engn Res Inst CSSC, Beijing 10094, Peoples R China
基金
美国国家科学基金会;
关键词
feature diversity; rank upper bound; loss function; image up-sampling; deep learning;
D O I
10.3390/rs16030436
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Deep learning is an important research topic in the field of image super-resolution. Problematically, the performance of existing hyperspectral image super-resolution networks is limited by feature learning for hyperspectral images. Nevertheless, the current algorithms exhibit some limitations in extracting diverse features. In this paper, we address limitations to existing hyperspectral image super-resolution networks, focusing on feature learning challenges. We introduce the Channel-Attention-Based Spatial-Spectral Feature Extraction network (CSSFENet) to enhance hyperspectral image feature diversity and optimize network loss functions. Our contributions include: (a) a convolutional neural network super-resolution algorithm incorporating diverse feature extraction to enhance the network's diversity feature learning by elevating the matrix rank, (b) a three-dimensional (3D) feature extraction convolution module, the Channel-Attention-Based Spatial-Spectral Feature Extraction Module (CSSFEM), to boost the network's performance in both the spatial and spectral domains, (c) a feature diversity loss function designed based on the image matrix's singular value to maximize element independence, and (d) a spatial-spectral gradient loss function introduced based on space and spectrum gradient values to enhance the reconstructed image's spatial-spectral smoothness. In contrast to existing hyperspectral super-resolution algorithms, we used four evaluation indexes, PSNR, mPSNR, SSIM, and SAM, and our method showed superiority during testing with three common hyperspectral datasets.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] StructureColor Preserving Network for Hyperspectral Image Super-Resolution
    Pan, Bin
    Qu, Qiaoying
    Xu, Xia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [32] Domain Transfer Learning for Hyperspectral Image Super-Resolution
    Li, Xiaoyan
    Zhang, Lefei
    You, Jane
    REMOTE SENSING, 2019, 11 (06)
  • [33] Restoration and Calibration of Tilting Hyperspectral Super-Resolution Image
    Zhang, Xizhen
    Zhang, Aiwu
    Li, Mengnan
    Liu, Lulu
    Kang, Xiaoyan
    SENSORS, 2020, 20 (16) : 1 - 21
  • [34] Hyperspectral Image Super-Resolution via Intrafusion Network
    Hu, Jing
    Jia, Xiuping
    Li, Yunsong
    He, Gang
    Zhao, Minghua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (10): : 7459 - 7471
  • [35] Multilevel Interaction Embedding for Hyperspectral Image Super-Resolution
    Zhang, Mingjian
    Zheng, Ling
    Weng, Shizhuang
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 59 - 61
  • [36] Exploring the Spectral Prior for Hyperspectral Image Super-Resolution
    Hu, Qian
    Wang, Xinya
    Jiang, Junjun
    Zhang, Xiao-Ping
    Ma, Jiayi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5260 - 5272
  • [37] Hyperspectral Image Super-Resolution with Optimized RGB Guidance
    Fu, Ying
    Zhang, Tao
    Zheng, Yinqiang
    Zhang, Debing
    Huang, Hua
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11653 - 11662
  • [38] ESSAformer: Efficient Transformer for Hyperspectral Image Super-resolution
    Zhang, Mingjin
    Zhang, Chi
    Zhang, Qiming
    Guo, Jie
    Gao, Xinbo
    Zhang, Jing
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 23016 - 23027
  • [39] Synthetic Data Pretraining for Hyperspectral Image Super-Resolution
    Aiello, Emanuele
    Agarla, Mirko
    Valsesia, Diego
    Napoletano, Paolo
    Bianchi, Tiziano
    Magli, Enrico
    Schettini, Raimondo
    IEEE ACCESS, 2024, 12 : 65024 - 65031
  • [40] Deep Recursive Network for Hyperspectral Image Super-Resolution
    Wei, Wei
    Nie, Jiangtao
    Li, Yong
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 (06) : 1233 - 1244