Spatial-Spectral Transformer for Hyperspectral Image Denoising

被引:0
|
作者
Li, Miaoyu [1 ]
Fu, Ying [1 ]
Zhang, Yulun [2 ]
机构
[1] Beijing Inst Technol, Beijing, Peoples R China
[2] Swiss Fed Inst Technol, Zurich, Switzerland
基金
中国国家自然科学基金;
关键词
SPARSE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) denoising is a crucial preprocessing procedure for the subsequent HSI applications. Unfortunately, though witnessing the development of deep learning in HSI denoising area, existing convolution-based methods face the trade-off between computational efficiency and capability to model non-local characteristics of HSI. In this paper, we propose a Spatial-Spectral Transformer (SST) to alleviate this problem. To fully explore intrinsic similarity characteristics in both spatial dimension and spectral dimension, we conduct non-local spatial self-attention and global spectral self-attention with Transformer architecture. The window-based spatial self-attention focuses on the spatial similarity beyond the neighboring region. While, the spectral self-attention exploits the long-range dependencies between highly correlative bands. Experimental results show that our proposed method outperforms the state-of-the-art HSI denoising methods in quantitative quality and visual results. The code is released at https://github.com/MyuLi/SST.
引用
收藏
页码:1368 / 1376
页数:9
相关论文
共 50 条
  • [21] SPATIAL-SPECTRAL CONVOLUTIONAL SPARSE NEURAL NETWORK FOR HYPERSPECTRAL IMAGE DENOISING
    Xiong, Fengchao
    Ye, Minchao
    Zhou, Jun
    Qian, Yuntao
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1225 - 1228
  • [22] Multiscale spatial-spectral transformer network for hyperspectral and multispectral image fusion
    Jia, Sen
    Min, Zhichao
    Fu, Xiyou
    INFORMATION FUSION, 2023, 96 : 117 - 129
  • [23] Spatial-Spectral Transformer With Conditional Position Encoding for Hyperspectral Image Classification
    Ahmad, Muhammad
    Usama, Muhammad
    Khan, Adil Mehmood
    Distefano, Salvatore
    Altuwaijri, Hamad Ahmed
    Mazzara, Manuel
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [24] Regularized spatial-spectral transformer for domain adaptation in hyperspectral image classification
    Fang, Zhuoqun
    Hu, Yi
    Tan, Zhenhua
    Li, Zhaokui
    Yan, Zhuo
    He, Yutong
    Luo, Shaoteng
    Cao, Ye
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (04)
  • [25] Spatial-Spectral Transformer With Cross-Attention for Hyperspectral Image Classification
    Peng, Yishu
    Zhang, Yuwen
    Tu, Bing
    Li, Qianming
    Li, Wujing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [26] SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising
    Fu, Guanyiman
    Xiong, Fengchao
    Lu, Jianfeng
    Zhou, Jun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [27] Hyperspectral Image Denoising Using a Spatial-Spectral Monte Carlo Sampling Approach
    Xu, Linlin
    Li, Fan
    Wong, Alexander
    Clausi, David A.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) : 3025 - 3038
  • [28] CONVOLUTION ENHANCED SPATIAL-SPECTRAL UNIFIED TRANSFORMER NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Xin, Ziqi
    Li, Zhongwei
    Xu, Mingming
    Wang, Leiquan
    Zhu, Xue
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 2267 - 2270
  • [29] Graph-Transformer with spatial-spectral features fusion for hyperspectral image classification
    Zheng, Zhouzhou
    Debbagh, Mohamed
    Zhou, Xuehai
    Sun, Shangpeng
    Huang, Yuxiang
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 264
  • [30] DSS-TRM: deep spatial-spectral transformer for hyperspectral image classification
    Liu, Bing
    Yu, Anzhu
    Gao, Kuiliang
    Tan, Xiong
    Sun, Yifan
    Yu, Xuchu
    EUROPEAN JOURNAL OF REMOTE SENSING, 2022, 55 (01) : 103 - 114