SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

被引:5
|
作者
Fu, Guanyiman [1 ]
Xiong, Fengchao [1 ]
Lu, Jianfeng [1 ]
Zhou, Jun [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
基金
中国国家自然科学基金;
关键词
Noise reduction; Correlation; Transformers; Computational modeling; Complexity theory; Feature extraction; Solid modeling; Deep learning (DL); hyperspectral image (HSI) denoising; Mamba; spatial-spectral continuous scan (SSCS); RESTORATION;
D O I
10.1109/TGRS.2024.3446812
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intraimaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but often comes with high complexity. Based on the state space model (SSM), Mamba is known for its remarkable long-range dependency modeling capabilities and computational efficiency. Building on this, we introduce a memory-efficient spatial-spectral UMamba (SSUMamba) for HSI denoising, with the spatial-spectral continuous scan (SSCS) Mamba being the core component. SSCS Mamba alternates the row, column, and band in six different orders to generate the sequence and uses the bidirectional SSM to exploit long-range spatial-spectral dependencies. In each order, the images are rearranged between adjacent scans to ensure spatial-spectral continuity. In addition, 3-D convolutions are embedded into the SSCS Mamba to enhance local spatial-spectral modeling. Experiments demonstrate that SSUMamba achieves superior denoising results with lower memory consumption per batch compared with transformer-based methods. The source code is available at: https://github.com/lronkitty/SSUMamba.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Spatial-spectral coupling in hyperspectral CARS microscopy image
    Barlow, Aaron M.
    Popov, Konstantin
    Andreana, Marco
    Moffatt, Douglas J.
    Ridsdale, Andrew
    Slepkov, Aaron D.
    Ramunno, Lora
    Stolow, Albert
    THREE-DIMENSIONAL AND MULTIDIMENSIONAL MICROSCOPY: IMAGE ACQUISITION AND PROCESSING XX, 2013, 8589
  • [42] Hyperspectral Imagery Denoising Using a Spatial-Spectral Domain Mixing Prior
    Shao-Lin Chen
    Xi-Yuan Hu
    Si-Long Peng
    Journal of Computer Science and Technology, 2012, 27 : 851 - 861
  • [43] Hyperspectral Imagery Denoising Using a Spatial-Spectral Domain Mixing Prior
    陈绍林
    胡晰远
    彭思龙
    JournalofComputerScience&Technology, 2012, 27 (04) : 851 - 861
  • [44] Hyperspectral Image Denoising with a Combined Spatial and Spectral Weighted Hyperspectral Total Variation Model
    Jiang, Cheng
    Zhang, Hongyan
    Zhang, Liangpei
    Shen, Huanfeng
    Yuan, Qiangqiang
    CANADIAN JOURNAL OF REMOTE SENSING, 2016, 42 (01) : 53 - 72
  • [45] Hyperspectral Imagery Denoising Using a Spatial-Spectral Domain Mixing Prior
    Chen, Shao-Lin
    Hu, Xi-Yuan
    Peng, Si-Long
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2012, 27 (04) : 851 - 861
  • [46] Spatial-Spectral Total Variation Regularized Low-Rank Tensor Decomposition for Hyperspectral Image Denoising
    Fan, Haiyan
    Li, Chang
    Guo, Yulan
    Kuang, Gangyao
    Ma, Jiayi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (10): : 6196 - 6213
  • [47] Hyperspectral Image Denoising via Subspace Low-rank Representation and Spatial-spectral Total Variation
    Ye, Jun
    Zhang, Xian
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2020, 64 (01)
  • [48] Joint Spatial-Spectral Attention Network for Hyperspectral Image Classification
    Li, Lei
    Yin, Jihao
    Jia, Xiuping
    Li, Sen
    Han, Bingnan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (10) : 1816 - 1820
  • [49] Pyramid Hierarchical Spatial-Spectral Transformer for Hyperspectral Image Classification
    Ahmad, Muhammad
    Butt, Muhammad Hassaan Farooq
    Mazzara, Manuel
    Distefano, Salvatore
    Khan, Adil Mehmood
    Altuwaijri, Hamad Ahmed
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 17681 - 17689
  • [50] SSUM: Spatial-Spectral Unified Mamba for Hyperspectral Image Classification
    Lu, Song
    Zhang, Min
    Huo, Yu
    Wang, Chenhao
    Wang, Jingwen
    Gao, Chenyu
    REMOTE SENSING, 2024, 16 (24)