SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

被引:5
|
作者
Fu, Guanyiman [1 ]
Xiong, Fengchao [1 ]
Lu, Jianfeng [1 ]
Zhou, Jun [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
基金
中国国家自然科学基金;
关键词
Noise reduction; Correlation; Transformers; Computational modeling; Complexity theory; Feature extraction; Solid modeling; Deep learning (DL); hyperspectral image (HSI) denoising; Mamba; spatial-spectral continuous scan (SSCS); RESTORATION;
D O I
10.1109/TGRS.2024.3446812
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intraimaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but often comes with high complexity. Based on the state space model (SSM), Mamba is known for its remarkable long-range dependency modeling capabilities and computational efficiency. Building on this, we introduce a memory-efficient spatial-spectral UMamba (SSUMamba) for HSI denoising, with the spatial-spectral continuous scan (SSCS) Mamba being the core component. SSCS Mamba alternates the row, column, and band in six different orders to generate the sequence and uses the bidirectional SSM to exploit long-range spatial-spectral dependencies. In each order, the images are rearranged between adjacent scans to ensure spatial-spectral continuity. In addition, 3-D convolutions are embedded into the SSCS Mamba to enhance local spatial-spectral modeling. Experiments demonstrate that SSUMamba achieves superior denoising results with lower memory consumption per batch compared with transformer-based methods. The source code is available at: https://github.com/lronkitty/SSUMamba.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Multiscale Spatial-Spectral Invertible Compensation Network for Hyperspectral Remote Sensing Image Denoising
    Li, Huiyang
    Ren, Kai
    Sun, Weiwei
    Yang, Gang
    Meng, Xiangchao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [22] SQAD: Spatial-Spectral Quasi-Attention Recurrent Network for Hyperspectral Image Denoising
    Pan, Erting
    Ma, Yong
    Mei, Xiaoguang
    Fan, Fan
    Huang, Jun
    Ma, Jiayi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [23] Hider: A Hyperspectral Image Denoising Transformer With Spatial-Spectral Constraints for Hybrid Noise Removal
    Chen, Hongyu
    Yang, Guangyi
    Zhang, Hongyan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 8797 - 8811
  • [24] Spatial-Spectral ConvNeXt for Hyperspectral Image Classification
    Zhu, Yimin
    Yuan, Kexin
    Zhong, Wenlong
    Xu, Linlin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 (5453-5463) : 5453 - 5463
  • [25] Spatial-spectral Compressive Sensing of Hyperspectral Image
    Wang, Zhongliang
    Feng, Yan
    Jia, Yinbiao
    2013 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2013, : 1256 - 1259
  • [26] SPATIAL-SPECTRAL HYPERSPECTRAL IMAGE COMPRESSIVE SENSING
    Martin, Gabriel
    Bioucas-Dias, Jose M.
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 3988 - 3991
  • [27] Spatial-Spectral Transformer for Hyperspectral Image Classification
    He, Xin
    Chen, Yushi
    Lin, Zhouhan
    REMOTE SENSING, 2021, 13 (03) : 1 - 22
  • [28] Spatial-Spectral BERT for Hyperspectral Image Classification
    Ashraf, Mahmood
    Zhou, Xichuan
    Vivone, Gemine
    Chen, Lihui
    Chen, Rong
    Majdard, Reza Seifi
    REMOTE SENSING, 2024, 16 (03)
  • [29] Hyperspectral Image Denoising Using Group Low-Rank and Spatial-Spectral Total Variation
    Ince, Taner
    IEEE ACCESS, 2019, 7 : 52095 - 52109
  • [30] LR-Net: Low-Rank Spatial-Spectral Network for Hyperspectral Image Denoising
    Zhang, Hongyan
    Chen, Hongyu
    Yang, Guangyi
    Zhang, Liangpei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8743 - 8758