SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

被引:5
|
作者
Fu, Guanyiman [1 ]
Xiong, Fengchao [1 ]
Lu, Jianfeng [1 ]
Zhou, Jun [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
基金
中国国家自然科学基金;
关键词
Noise reduction; Correlation; Transformers; Computational modeling; Complexity theory; Feature extraction; Solid modeling; Deep learning (DL); hyperspectral image (HSI) denoising; Mamba; spatial-spectral continuous scan (SSCS); RESTORATION;
D O I
10.1109/TGRS.2024.3446812
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intraimaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but often comes with high complexity. Based on the state space model (SSM), Mamba is known for its remarkable long-range dependency modeling capabilities and computational efficiency. Building on this, we introduce a memory-efficient spatial-spectral UMamba (SSUMamba) for HSI denoising, with the spatial-spectral continuous scan (SSCS) Mamba being the core component. SSCS Mamba alternates the row, column, and band in six different orders to generate the sequence and uses the bidirectional SSM to exploit long-range spatial-spectral dependencies. In each order, the images are rearranged between adjacent scans to ensure spatial-spectral continuity. In addition, 3-D convolutions are embedded into the SSCS Mamba to enhance local spatial-spectral modeling. Experiments demonstrate that SSUMamba achieves superior denoising results with lower memory consumption per batch compared with transformer-based methods. The source code is available at: https://github.com/lronkitty/SSUMamba.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Spatial-Spectral Clustering With Anchor Graph for Hyperspectral Image
    Wang, Qi
    Miao, Yanling
    Chen, Mulin
    Yuan, Yuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [32] A spatial-spectral SIFT for hyperspectral image matching and classification
    Li, Yanshan
    Li, Qingteng
    Liu, Yan
    Xie, Weixin
    PATTERN RECOGNITION LETTERS, 2019, 127 : 18 - 26
  • [33] Learning Spatial-Spectral Features for Hyperspectral Image Classification
    Shu, Lei
    McIsaac, Kenneth
    Osinski, Gordon R.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (09): : 5138 - 5147
  • [34] Deep Spatial-Spectral Subspace Clustering for Hyperspectral Image
    Lei, Jianjun
    Li, Xinyu
    Peng, Bo
    Fang, Leyuan
    Ling, Nam
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (07) : 2686 - 2697
  • [35] Hyperspectral image segmentation using spatial-spectral graphs
    Gillis, David B.
    Bowles, Jeffrey H.
    ALGORITHMS AND TECHNOLOGIES FOR MULTISPECTRAL, HYPERSPECTRAL, AND ULTRASPECTRAL IMAGERY XVIII, 2012, 8390
  • [36] Spatial-spectral morphological mamba for hyperspectral image classification
    Ahmad, Muhammad
    Butt, Muhammad Hassaan Farooq
    Khan, Adil Mehmood
    Mazzara, Manuel
    Distefano, Salvatore
    Usama, Muhammad
    Roy, Swalpa Kumar
    Chanussot, Jocelyn
    Hong, Danfeng
    NEUROCOMPUTING, 2025, 636
  • [37] A Spatial-Spectral Feature Descriptor for Hyperspectral Image Matching
    Yu, Yang
    Ma, Yong
    Mei, Xiaoguang
    Fan, Fan
    Huang, Jun
    Ma, Jiayi
    REMOTE SENSING, 2021, 13 (23)
  • [38] Spatial-Spectral Decoupling Framework for Hyperspectral Image Classification
    Fang, Jie
    Zhu, Zhijie
    He, Guanghua
    Wang, Nan
    Cao, Xiaoqian
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [39] SPATIAL-SPECTRAL CONTRASTIVE LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Guan, Peiyan
    Lam, Edmund Y.
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1372 - 1375
  • [40] MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classification
    Li, Yapeng
    Luo, Yong
    Zhang, Lefei
    Wang, Zengmao
    Du, Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 1