Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising

被引:0
|
作者
Zeng, Haijin [1 ,2 ]
Feng, Kai [3 ]
Zhao, Xudong [4 ]
Cao, Jiezhang [5 ]
Huang, Shaoguang [6 ]
Luong, Hiep [1 ,2 ]
Philips, Wilfried [1 ,2 ]
机构
[1] IMEC, B-3001 Leuven, Belgium
[2] Univ Ghent, Dept Telecommun & Informat Proc, B-9000 Ghent, Belgium
[3] Northwestern Polytech Univ, Sch Automat, Xian 710071, Peoples R China
[4] Beijing Inst Technol, Sch Informat & Elect, Beijing 100811, Peoples R China
[5] Swiss Fed Inst Technol, Dept Comp Sci, CH-8092 Zurich, Switzerland
[6] China Univ Geosci, Sch Comp Sci, Wuhan 430079, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Noise; Noise reduction; Transformers; Degradation; Uncertainty; Adaptation models; Noise measurement; Three-dimensional displays; Correlation; Training; Noise model; remote sensing; spectral denoising; transformer; unfolding; RANK TENSOR RECOVERY; TUBAL-RANK; RESTORATION; REPRESENTATION; MODEL;
D O I
10.1109/TGRS.2025.3543920
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) play a pivotal role in fields, such as medical diagnosis and agriculture. However, it often contends with significant noise stemming from narrowband spectral filtering. Existing denoising techniques have their limitations: model-driven methods rely on manual priors and hyperparameters, while learning-based methods struggle to discern intrinsic noise patterns, as they require paired images with specific example noise for training, fail to capture critical noise distribution information, leading to unrobust denoising results. This work addresses the issue by presenting a degradation-noise-aware unfolding network (DNA-Net). Unlike training directly with the simulated noise, DNA-Net initially models general sparse and Gaussian noise through statistic distributions. It then explicitly represents image priors with a customized spectral transformer. The model is subsequently unfolded into an end-to-end (E2E) network, with hyperparameters adaptively estimated from noisy HSI and degradation models, effectively regulating each iteration. Furthermore, a novel U-shaped local-nonlocal-spectral transformer (U-LNSA) is introduced, simultaneously capturing spectral correlations, local features, and nonlocal dependencies. The integration of U-LNSA into DNA-Net establishes the first Transformer-based deep unfolding method for HSI denoising. Experimental results on synthetic and real noise validate DNA-Net's superior performance over state-of-the-art (SOTA) methods. Moreover, the DNA-Net, trained exclusively on mixed Gaussian noise and impulse noise, demonstrates the ability to generalize to unseen noise present in real images. Code and models will be released at: https://github.com/NavyZeng/DNA-Net.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Multiscale-Sparse Spatial-Spectral Transformer for Hyperspectral Image Denoising
    Xiao, Zilong
    Qin, Hanlin
    Yang, Shuowen
    Yan, Xiang
    Zhou, Huixin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [42] Low-Rank Prompt-Guided Transformer for Hyperspectral Image Denoising
    Tan, Xiaodong
    Shao, Mingwen
    Qiao, Yuanjian
    Liu, Tiyao
    Cao, Xiangyong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [43] Real image noise aware steganography with image denoising and generative adversarial network
    Toguchi, Shinnosuke
    Miyata, Takamichi
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2024, 15 (04): : 737 - 749
  • [44] Hyperspectral Image Classification Using Group-Aware Hierarchical Transformer
    Mei, Shaohui
    Song, Chao
    Ma, Mingyang
    Xu, Fulin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [45] A CNN-Transformer Embedded Unfolding Network for Hyperspectral Image Super-Resolution
    Tang, Yao
    Li, Jie
    Yue, Linwei
    Liu, Xinxin
    Li, Yajie
    Xiao, Yi
    Yuan, Qiangqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [46] Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging
    Cai, Yuanhao
    Lin, Jing
    Wang, Haoqian
    Yuan, Xin
    Ding, Henghui
    Zhang, Yulun
    Timofte, Radu
    Van Gool, Luc
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [47] Hyperspectral Image Denoising via Matrix Factorization and Deep Prior Regularization
    Lin, Baihong
    Tao, Xiaoming
    Lu, Jianhua
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 565 - 578
  • [48] Deep Spatial-Spectral Representation Learning for Hyperspectral Image Denoising
    Dong, Weisheng
    Wang, Huan
    Wu, Fangfang
    Shi, Guangming
    Li, Xin
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2019, 5 (04) : 635 - 648
  • [49] DEEP SPARSE AND LOW-RANK PRIOR FOR HYPERSPECTRAL IMAGE DENOISING
    Nguyen, Han V.
    Ulfarsson, Magnus O.
    Sigurdsson, Jakob
    Sveinsson, Johannes R.
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1217 - 1220
  • [50] Three-Dimension Spatial-Spectral Attention Transformer for Hyperspectral Image Denoising
    Zhang, Qiang
    Dong, Yushuai
    Zheng, Yaming
    Yu, Haoyang
    Song, Meiping
    Zhang, Lifu
    Yuan, Qiangqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62