Hyperspectral Image Super-Resolution Based on Spatial-Spectral-Frequency Multidimensional Features

被引:0
|
作者
Sifan Zheng [1 ,2 ]
Tao Zhang [1 ,2 ]
Haibing Yin [1 ,2 ]
Hao Hu [3 ]
Jian Jiang [3 ]
Chenggang Yan [1 ,2 ]
机构
[1] School of Communication Engineering, Hangzhou Dianzi University
[2] Lishui Institute of Hangzhou Dianzi University
[3] China Mobile (Zhejiang) Innovation Research Institute Co,
关键词
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
Due to the limitations of existing imaging hardware, obtaining high-resolution hyperspectral images is challenging. Hyperspectral image super-resolution(HSI SR) has been a very attractive research topic in computer vision, attracting the attention of many researchers. However, most HSI SR methods focus on the tradeoff between spatial resolution and spectral information, and cannot guarantee the efficient extraction of image information. In this paper, a multidimensional features network(MFNet) for HSI SR is proposed, which simultaneously learns and fuses the spatial,spectral, and frequency multidimensional features of HSI. Spatial features contain rich local details,spectral features contain the information and correlation between spectral bands, and frequency feature can reflect the global information of the image and can be used to obtain the global context of HSI. The fusion of the three features can better guide image super-resolution, to obtain higher-quality high-resolution hyperspectral images. In MFNet, we use the frequency feature extraction module(FFEM) to extract the frequency feature. On this basis, a multidimensional features extraction module(MFEM) is designed to learn and fuse multidimensional features. In addition, experimental results on two public datasets demonstrate that MFNet achieves state-of-the-art performance.
引用
收藏
页码:28 / 41
页数:14
相关论文
共 50 条
  • [41] Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery
    Jiang, Junjun
    Sun, He
    Liu, Xianming
    Ma, Jiayi
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 1082 - 1096
  • [42] Hyperspectral image super-resolution combining with deep learning and spectral unmixing
    Zou, Changzhong
    Huang, Xusheng
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 84
  • [43] HYPERSPECTRAL IMAGE SUPER-RESOLUTION VIA ADJACENT SPECTRAL FUSION STRATEGY
    Li, Qiang
    Wang, Qi
    Li, Xuelong
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1645 - 1649
  • [44] Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution
    Akhtar, Naveed
    Shafait, Faisal
    Mian, Ajmal
    COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 : 63 - 78
  • [45] Hyperspectral Image Super-Resolution via Sparsity Regularization-Based Spatial-Spectral Tensor Subspace Representation
    Peng, Yidong
    Li, Weisheng
    Luo, Xiaobo
    Du, Jiao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11707 - 11722
  • [46] Combining global receptive field and spatial spectral information for single-image hyperspectral super-resolution
    Wu, Yiming
    Cao, Ronghui
    Hu, Yikun
    Wang, Jin
    Li, Kenli
    NEUROCOMPUTING, 2023, 542
  • [47] Joint Spatial-Spectral Smoothing in a Minimum-Volume Simplex for Hyperspectral Image Super-Resolution
    Ma, Fei
    Yang, Feixia
    Ping, Ziliang
    Wang, Wenqin
    APPLIED SCIENCES-BASEL, 2020, 10 (01):
  • [48] Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution
    Xue, Jize
    Zhao, Yong-Qiang
    Bu, Yuanyang
    Liao, Wenzhi
    Chan, Jonathan Cheung-Wai
    Philips, Wilfried
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3084 - 3097
  • [49] Dual ODE: Spatial-Spectral Neural Ordinary Differential Equations for Hyperspectral Image Super-Resolution
    Zhang, Xiao
    Song, Chongxing
    You, Tao
    Bai, Qicheng
    Wei, Wei
    Zhang, Lei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [50] Hyperspectral Image Joint Super-Resolution via Local Implicit Spatial-Spectral Function Learning
    Zhang, Yanan
    Zhang, Jizhou
    Han, Sijia
    IEEE PHOTONICS JOURNAL, 2024, 16 (03): : 1 - 12