Hyperspectral Image Super-Resolution Based on Spatial-Spectral-Frequency Multidimensional Features

被引:0
|
作者
Sifan Zheng [1 ,2 ]
Tao Zhang [1 ,2 ]
Haibing Yin [1 ,2 ]
Hao Hu [3 ]
Jian Jiang [3 ]
Chenggang Yan [1 ,2 ]
机构
[1] School of Communication Engineering, Hangzhou Dianzi University
[2] Lishui Institute of Hangzhou Dianzi University
[3] China Mobile (Zhejiang) Innovation Research Institute Co,
关键词
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
Due to the limitations of existing imaging hardware, obtaining high-resolution hyperspectral images is challenging. Hyperspectral image super-resolution(HSI SR) has been a very attractive research topic in computer vision, attracting the attention of many researchers. However, most HSI SR methods focus on the tradeoff between spatial resolution and spectral information, and cannot guarantee the efficient extraction of image information. In this paper, a multidimensional features network(MFNet) for HSI SR is proposed, which simultaneously learns and fuses the spatial,spectral, and frequency multidimensional features of HSI. Spatial features contain rich local details,spectral features contain the information and correlation between spectral bands, and frequency feature can reflect the global information of the image and can be used to obtain the global context of HSI. The fusion of the three features can better guide image super-resolution, to obtain higher-quality high-resolution hyperspectral images. In MFNet, we use the frequency feature extraction module(FFEM) to extract the frequency feature. On this basis, a multidimensional features extraction module(MFEM) is designed to learn and fuse multidimensional features. In addition, experimental results on two public datasets demonstrate that MFNet achieves state-of-the-art performance.
引用
收藏
页码:28 / 41
页数:14
相关论文
共 50 条
  • [31] A Spectral Diffusion Prior for Unsupervised Hyperspectral Image Super-Resolution
    Liu, Jianjun
    Wu, Zebin
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [32] Hyperspectral Image Super-Resolution Based on Spatial Group Sparsity Regularization Unmixing
    Li, Jun
    Peng, Yuanxi
    Jiang, Tian
    Zhang, Longlong
    Long, Jian
    APPLIED SCIENCES-BASEL, 2020, 10 (16):
  • [33] A SPATIAL CONSTRAINT AND DEEP LEARNING BASED HYPERSPECTRAL IMAGE SUPER-RESOLUTION METHOD
    Hu, Jing
    Li, Yunsong
    Zhao, Xi
    Xie, Weiying
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 5129 - 5132
  • [34] Generative adversarial networks for hyperspectral image spatial super-resolution
    Jiang Yilin
    Shao Ran
    Tang Sanqiang
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2020, 27 (04) : 8 - 16
  • [35] Hyperspectral Image Super-Resolution with RGB Image Super-Resolution as an Auxiliary Task
    Li, Ke
    Dai, Dengxin
    van Gool, Luc
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 4039 - 4048
  • [36] Hyperspectral Image Super-Resolution by Deep Spatial -Spectral Exploitation (vol 11, 1229, 2019)
    Hu, Jing
    Zhao, Minghua
    Li, Yunsong
    REMOTE SENSING, 2019, 11 (24)
  • [37] Hyperspectral Image Super-Resolution with Self-Supervised Spectral-Spatial Residual Network
    Chen, Wenjing
    Zheng, Xiangtao
    Lu, Xiaoqiang
    REMOTE SENSING, 2021, 13 (07)
  • [38] Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution
    Chen, Shi
    Zhang, Lefei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5878 - 5891
  • [39] An efficient unfolding network with disentangled spatial-spectral representation for hyperspectral image super-resolution
    Liu, Denghong
    Li, Jie
    Yuan, Qiangqiang
    Zheng, Li
    He, Jiang
    Zhao, Shuheng
    Xiao, Yi
    INFORMATION FUSION, 2023, 94 : 92 - 111
  • [40] IMAGE FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Irmak, Hasan
    Akar, Gozde Bozdagi
    Yuksel, Seniha Esen
    2018 9TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2018,