SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

被引:5
|
作者
Fu, Guanyiman [1 ]
Xiong, Fengchao [1 ]
Lu, Jianfeng [1 ]
Zhou, Jun [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
基金
中国国家自然科学基金;
关键词
Noise reduction; Correlation; Transformers; Computational modeling; Complexity theory; Feature extraction; Solid modeling; Deep learning (DL); hyperspectral image (HSI) denoising; Mamba; spatial-spectral continuous scan (SSCS); RESTORATION;
D O I
10.1109/TGRS.2024.3446812
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intraimaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but often comes with high complexity. Based on the state space model (SSM), Mamba is known for its remarkable long-range dependency modeling capabilities and computational efficiency. Building on this, we introduce a memory-efficient spatial-spectral UMamba (SSUMamba) for HSI denoising, with the spatial-spectral continuous scan (SSCS) Mamba being the core component. SSCS Mamba alternates the row, column, and band in six different orders to generate the sequence and uses the bidirectional SSM to exploit long-range spatial-spectral dependencies. In each order, the images are rearranged between adjacent scans to ensure spatial-spectral continuity. In addition, 3-D convolutions are embedded into the SSCS Mamba to enhance local spatial-spectral modeling. Experiments demonstrate that SSUMamba achieves superior denoising results with lower memory consumption per batch compared with transformer-based methods. The source code is available at: https://github.com/lronkitty/SSUMamba.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Spatial-Spectral Transformer for Hyperspectral Image Denoising
    Li, Miaoyu
    Fu, Ying
    Zhang, Yulun
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1368 - 1376
  • [2] Nonlocal Spatial-Spectral Neural Network for Hyperspectral Image Denoising
    Fu, Guanyiman
    Xiong, Fengchao
    Lu, Jianfeng
    Zhou, Jun
    Qian, Yuntao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Deep Spatial-Spectral Representation Learning for Hyperspectral Image Denoising
    Dong, Weisheng
    Wang, Huan
    Wu, Fangfang
    Shi, Guangming
    Li, Xin
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2019, 5 (04) : 635 - 648
  • [4] Adaptive Spatial-Spectral Dictionary Learning for Hyperspectral Image Denoising
    Fu, Ying
    Lam, Antony
    Sato, Imari
    Sato, Yoichi
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 343 - 351
  • [5] Hyperspectral Image Denoising via Spatial-Spectral Recurrent Transformer
    Fu, Guanyiman
    Xiong, Fengchao
    Lu, Jianfeng
    Zhou, Jun
    Zhou, Jiantao
    Qian, Yuntao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [6] Hyperspectral Image Denoising With a Spatial-Spectral View Fusion Strategy
    Yuan, Qiangqiang
    Zhang, Liangpei
    Shen, Huanfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (05): : 2314 - 2325
  • [7] SSCDN: a spatial-spectral collaborative network for hyperspectral image denoising
    Li, Kaixiang
    Li, Renjian
    Li, Guiye
    Liu, Shaojun
    He, Zhengdi
    Zhang, Meng
    Chen, Lingling
    OPTICS EXPRESS, 2024, 32 (19): : 32612 - 32628
  • [8] S2Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification
    Wang, Guanchun
    Zhang, Xiangrong
    Peng, Zelin
    Zhang, Tianyang
    Jiao, Licheng
    IEEE Transactions on Geoscience and Remote Sensing,
  • [9] A Neural Network for Hyperspectral Image Denoising by Combining Spatial-Spectral Information
    Lian, Xiaoying
    Yin, Zhonghai
    Zhao, Siwei
    Li, Dandan
    Lv, Shuai
    Pang, Boyu
    Sun, Dexin
    REMOTE SENSING, 2023, 15 (21)
  • [10] Spatial-spectral weighted nuclear norm minimization for hyperspectral image denoising
    Huang, Xinjian
    Du, Bo
    Tao, Dapeng
    Zhang, Liangpei
    NEUROCOMPUTING, 2020, 399 : 271 - 284