Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising

被引:0
|
作者
Zeng, Haijin [1 ,2 ]
Feng, Kai [3 ]
Zhao, Xudong [4 ]
Cao, Jiezhang [5 ]
Huang, Shaoguang [6 ]
Luong, Hiep [1 ,2 ]
Philips, Wilfried [1 ,2 ]
机构
[1] IMEC, B-3001 Leuven, Belgium
[2] Univ Ghent, Dept Telecommun & Informat Proc, B-9000 Ghent, Belgium
[3] Northwestern Polytech Univ, Sch Automat, Xian 710071, Peoples R China
[4] Beijing Inst Technol, Sch Informat & Elect, Beijing 100811, Peoples R China
[5] Swiss Fed Inst Technol, Dept Comp Sci, CH-8092 Zurich, Switzerland
[6] China Univ Geosci, Sch Comp Sci, Wuhan 430079, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Noise; Noise reduction; Transformers; Degradation; Uncertainty; Adaptation models; Noise measurement; Three-dimensional displays; Correlation; Training; Noise model; remote sensing; spectral denoising; transformer; unfolding; RANK TENSOR RECOVERY; TUBAL-RANK; RESTORATION; REPRESENTATION; MODEL;
D O I
10.1109/TGRS.2025.3543920
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) play a pivotal role in fields, such as medical diagnosis and agriculture. However, it often contends with significant noise stemming from narrowband spectral filtering. Existing denoising techniques have their limitations: model-driven methods rely on manual priors and hyperparameters, while learning-based methods struggle to discern intrinsic noise patterns, as they require paired images with specific example noise for training, fail to capture critical noise distribution information, leading to unrobust denoising results. This work addresses the issue by presenting a degradation-noise-aware unfolding network (DNA-Net). Unlike training directly with the simulated noise, DNA-Net initially models general sparse and Gaussian noise through statistic distributions. It then explicitly represents image priors with a customized spectral transformer. The model is subsequently unfolded into an end-to-end (E2E) network, with hyperparameters adaptively estimated from noisy HSI and degradation models, effectively regulating each iteration. Furthermore, a novel U-shaped local-nonlocal-spectral transformer (U-LNSA) is introduced, simultaneously capturing spectral correlations, local features, and nonlocal dependencies. The integration of U-LNSA into DNA-Net establishes the first Transformer-based deep unfolding method for HSI denoising. Experimental results on synthetic and real noise validate DNA-Net's superior performance over state-of-the-art (SOTA) methods. Moreover, the DNA-Net, trained exclusively on mixed Gaussian noise and impulse noise, demonstrates the ability to generalize to unseen noise present in real images. Code and models will be released at: https://github.com/NavyZeng/DNA-Net.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Blind Hyperspectral Image Denoising with Degradation Information Learning
    Wei, Xing
    Xiao, Jiahua
    Gong, Yihong
    REMOTE SENSING, 2023, 15 (02)
  • [22] A Deep Unfolding Network for Multispectral and Hyperspectral Image Fusion
    Zhang, Bihui
    Cao, Xiangyong
    Meng, Deyu
    REMOTE SENSING, 2024, 16 (21)
  • [23] Hyperspectral Image Denoising Using Uncertainty-Aware Adjustor
    Xiao, Jiahua
    Wei, Xing
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1560 - 1568
  • [24] Hyperspectral Image Denoising by Pixel-Wise Noise Modeling and TV-Oriented Deep Image Prior
    Yi, Lixuan
    Zhao, Qian
    Xu, Zongben
    REMOTE SENSING, 2024, 16 (15)
  • [25] Deep Parameterized Neural Networks for Hyperspectral Image Denoising
    Xiong, Fengchao
    Zhou, Jun
    Zhou, Jiantao
    Lu, Jianfeng
    Qian, Yuntao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [26] Deep Parameterized Neural Networks for Hyperspectral Image Denoising
    Xiong, Fengchao
    Zhou, Jun
    Zhou, Jiantao
    Lu, Jianfeng
    Qian, Yuntao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [27] Transformative Noise Reduction: Leveraging a Transformer-Based Deep Network for Medical Image Denoising
    Naqvi, Rizwan Ali
    Haider, Amir
    Kim, Hak Seob
    Jeong, Daesik
    Lee, Seung-Won
    MATHEMATICS, 2024, 12 (15)
  • [28] Twofold dynamic attention guided deep network and noise-aware mechanism for image denoising
    Chen, Zihao
    Raj, Alex Noel Joseph
    Rajangam, Vijayarajan
    Li, Wei
    Mahesh, Vijayalakshmi G. V.
    Zhuang, Zhemin
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (03) : 87 - 102
  • [29] Hyperspectral Image Denoising via Spatial-Spectral Recurrent Transformer
    Fu, Guanyiman
    Xiong, Fengchao
    Lu, Jianfeng
    Zhou, Jun
    Zhou, Jiantao
    Qian, Yuntao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [30] Hyperspectral image denoising via spectral noise distribution bootstrap
    Pan, Erting
    Ma, Yong
    Mei, Xiaoguang
    Fan, Fan
    Ma, Jiayi
    PATTERN RECOGNITION, 2023, 142