Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising

被引:0
|
作者
Zeng, Haijin [1 ,2 ]
Feng, Kai [3 ]
Zhao, Xudong [4 ]
Cao, Jiezhang [5 ]
Huang, Shaoguang [6 ]
Luong, Hiep [1 ,2 ]
Philips, Wilfried [1 ,2 ]
机构
[1] IMEC, B-3001 Leuven, Belgium
[2] Univ Ghent, Dept Telecommun & Informat Proc, B-9000 Ghent, Belgium
[3] Northwestern Polytech Univ, Sch Automat, Xian 710071, Peoples R China
[4] Beijing Inst Technol, Sch Informat & Elect, Beijing 100811, Peoples R China
[5] Swiss Fed Inst Technol, Dept Comp Sci, CH-8092 Zurich, Switzerland
[6] China Univ Geosci, Sch Comp Sci, Wuhan 430079, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Noise; Noise reduction; Transformers; Degradation; Uncertainty; Adaptation models; Noise measurement; Three-dimensional displays; Correlation; Training; Noise model; remote sensing; spectral denoising; transformer; unfolding; RANK TENSOR RECOVERY; TUBAL-RANK; RESTORATION; REPRESENTATION; MODEL;
D O I
10.1109/TGRS.2025.3543920
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) play a pivotal role in fields, such as medical diagnosis and agriculture. However, it often contends with significant noise stemming from narrowband spectral filtering. Existing denoising techniques have their limitations: model-driven methods rely on manual priors and hyperparameters, while learning-based methods struggle to discern intrinsic noise patterns, as they require paired images with specific example noise for training, fail to capture critical noise distribution information, leading to unrobust denoising results. This work addresses the issue by presenting a degradation-noise-aware unfolding network (DNA-Net). Unlike training directly with the simulated noise, DNA-Net initially models general sparse and Gaussian noise through statistic distributions. It then explicitly represents image priors with a customized spectral transformer. The model is subsequently unfolded into an end-to-end (E2E) network, with hyperparameters adaptively estimated from noisy HSI and degradation models, effectively regulating each iteration. Furthermore, a novel U-shaped local-nonlocal-spectral transformer (U-LNSA) is introduced, simultaneously capturing spectral correlations, local features, and nonlocal dependencies. The integration of U-LNSA into DNA-Net establishes the first Transformer-based deep unfolding method for HSI denoising. Experimental results on synthetic and real noise validate DNA-Net's superior performance over state-of-the-art (SOTA) methods. Moreover, the DNA-Net, trained exclusively on mixed Gaussian noise and impulse noise, demonstrates the ability to generalize to unseen noise present in real images. Code and models will be released at: https://github.com/NavyZeng/DNA-Net.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Patch-Aware Deep Hyperspectral and Multispectral Image Fusion by Unfolding Subspace-Based Optimization Model
    Liu, Jianjun
    Shen, Dunbin
    Wu, Zebin
    Xiao, Liang
    Sun, Jun
    Yan, Hong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 1024 - 1038
  • [32] Degradation-Aware Transformer for Single Image Deraining
    Zhao, Peijun
    Wang, Tongjun
    IEEE ACCESS, 2023, 11 : 97274 - 97283
  • [33] Hyperspectral Image Denoising Based on Deep and Total Variation Priors
    Wang, Peng
    Sun, Tianman
    Chen, Yiming
    Ge, Lihua
    Wang, Xiaoyi
    Wang, Liguo
    REMOTE SENSING, 2024, 16 (12)
  • [34] Deep Tensor Attention Prior Network for Hyperspectral Image Denoising
    Shen, Weilin
    Liu, Junmin
    Li, Jinhai
    Tian, Chao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 6448 - 6462
  • [35] Hyperspectral Image Denoising via Double Subspace Deep Prior
    Shi, Kexin
    Peng, Jiangjun
    Gao, Jing
    Luo, Yisi
    Xu, Shuang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [36] A Noise-Level-Aware Framework for PET Image Denoising
    Li, Ye
    Cui, Jianan
    Chen, Junyu
    Zeng, Guodong
    Wollenweber, Scott
    Jansen, Floris
    Jang, Se-In
    Kim, Kyungsang
    Gong, Kuang
    Li, Quanzheng
    MACHINE LEARNING FOR MEDICAL IMAGE RECONSTRUCTION (MLMIR 2022), 2022, 13587 : 75 - 83
  • [37] Deep unfolding multi-scale regularizer network for image denoising
    Jingzhao Xu
    Mengke Yuan
    Dong-Ming Yan
    Tieru Wu
    Computational Visual Media, 2023, 9 : 335 - 350
  • [38] Evolving Deep Convolutional Neural Networks for Hyperspectral Image Denoising
    Liu, Yuqiao
    Sun, Yanan
    Xue, Bing
    Zhang, Mengjie
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [39] HYPERSPECTRAL UNMIXING POWERED BY DEEP IMAGE PRIORS AND DENOISING REGULARIZATION
    Zhao, Min
    Chen, Jie
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1776 - 1779
  • [40] Deep unfolding multi-scale regularizer network for image denoising
    Xu, Jingzhao
    Yuan, Mengke
    Yan, Dong-Ming
    Wu, Tieru
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (02) : 335 - 350