Spatial-Spectral Transformer for Hyperspectral Image Denoising

被引:0
|
作者
Li, Miaoyu [1 ]
Fu, Ying [1 ]
Zhang, Yulun [2 ]
机构
[1] Beijing Inst Technol, Beijing, Peoples R China
[2] Swiss Fed Inst Technol, Zurich, Switzerland
基金
中国国家自然科学基金;
关键词
SPARSE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) denoising is a crucial preprocessing procedure for the subsequent HSI applications. Unfortunately, though witnessing the development of deep learning in HSI denoising area, existing convolution-based methods face the trade-off between computational efficiency and capability to model non-local characteristics of HSI. In this paper, we propose a Spatial-Spectral Transformer (SST) to alleviate this problem. To fully explore intrinsic similarity characteristics in both spatial dimension and spectral dimension, we conduct non-local spatial self-attention and global spectral self-attention with Transformer architecture. The window-based spatial self-attention focuses on the spatial similarity beyond the neighboring region. While, the spectral self-attention exploits the long-range dependencies between highly correlative bands. Experimental results show that our proposed method outperforms the state-of-the-art HSI denoising methods in quantitative quality and visual results. The code is released at https://github.com/MyuLi/SST.
引用
收藏
页码:1368 / 1376
页数:9
相关论文
共 50 条
  • [1] Hyperspectral Image Denoising via Spatial-Spectral Recurrent Transformer
    Fu, Guanyiman
    Xiong, Fengchao
    Lu, Jianfeng
    Zhou, Jun
    Zhou, Jiantao
    Qian, Yuntao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [2] Multiscale-Sparse Spatial-Spectral Transformer for Hyperspectral Image Denoising
    Xiao, Zilong
    Qin, Hanlin
    Yang, Shuowen
    Yan, Xiang
    Zhou, Huixin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [3] Three-Dimension Spatial-Spectral Attention Transformer for Hyperspectral Image Denoising
    Zhang, Qiang
    Dong, Yushuai
    Zheng, Yaming
    Yu, Haoyang
    Song, Meiping
    Zhang, Lifu
    Yuan, Qiangqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [4] A Spatial-Spectral Transformer Network With Total Variation Loss for Hyperspectral Image Denoising
    Wang, Mengyuan
    He, Wei
    Zhang, Hongyan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [5] A Spatial-Spectral Transformer Network with Total Variation Loss for Hyperspectral Image Denoising
    Wang, Mengyuan
    He, Wei
    Zhang, Hongyan
    IEEE Geoscience and Remote Sensing Letters, 2023, 20
  • [6] Spatial-Spectral Transformer for Hyperspectral Image Classification
    He, Xin
    Chen, Yushi
    Lin, Zhouhan
    REMOTE SENSING, 2021, 13 (03) : 1 - 22
  • [7] Hider: A Hyperspectral Image Denoising Transformer With Spatial-Spectral Constraints for Hybrid Noise Removal
    Chen, Hongyu
    Yang, Guangyi
    Zhang, Hongyan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 8797 - 8811
  • [8] Nonlocal Spatial-Spectral Neural Network for Hyperspectral Image Denoising
    Fu, Guanyiman
    Xiong, Fengchao
    Lu, Jianfeng
    Zhou, Jun
    Qian, Yuntao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Deep Spatial-Spectral Representation Learning for Hyperspectral Image Denoising
    Dong, Weisheng
    Wang, Huan
    Wu, Fangfang
    Shi, Guangming
    Li, Xin
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2019, 5 (04) : 635 - 648
  • [10] Adaptive Spatial-Spectral Dictionary Learning for Hyperspectral Image Denoising
    Fu, Ying
    Lam, Antony
    Sato, Imari
    Sato, Yoichi
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 343 - 351