Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising

被引:0
|
作者
Zeng, Haijin [1 ,2 ]
Feng, Kai [3 ]
Zhao, Xudong [4 ]
Cao, Jiezhang [5 ]
Huang, Shaoguang [6 ]
Luong, Hiep [1 ,2 ]
Philips, Wilfried [1 ,2 ]
机构
[1] IMEC, B-3001 Leuven, Belgium
[2] Univ Ghent, Dept Telecommun & Informat Proc, B-9000 Ghent, Belgium
[3] Northwestern Polytech Univ, Sch Automat, Xian 710071, Peoples R China
[4] Beijing Inst Technol, Sch Informat & Elect, Beijing 100811, Peoples R China
[5] Swiss Fed Inst Technol, Dept Comp Sci, CH-8092 Zurich, Switzerland
[6] China Univ Geosci, Sch Comp Sci, Wuhan 430079, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Noise; Noise reduction; Transformers; Degradation; Uncertainty; Adaptation models; Noise measurement; Three-dimensional displays; Correlation; Training; Noise model; remote sensing; spectral denoising; transformer; unfolding; RANK TENSOR RECOVERY; TUBAL-RANK; RESTORATION; REPRESENTATION; MODEL;
D O I
10.1109/TGRS.2025.3543920
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) play a pivotal role in fields, such as medical diagnosis and agriculture. However, it often contends with significant noise stemming from narrowband spectral filtering. Existing denoising techniques have their limitations: model-driven methods rely on manual priors and hyperparameters, while learning-based methods struggle to discern intrinsic noise patterns, as they require paired images with specific example noise for training, fail to capture critical noise distribution information, leading to unrobust denoising results. This work addresses the issue by presenting a degradation-noise-aware unfolding network (DNA-Net). Unlike training directly with the simulated noise, DNA-Net initially models general sparse and Gaussian noise through statistic distributions. It then explicitly represents image priors with a customized spectral transformer. The model is subsequently unfolded into an end-to-end (E2E) network, with hyperparameters adaptively estimated from noisy HSI and degradation models, effectively regulating each iteration. Furthermore, a novel U-shaped local-nonlocal-spectral transformer (U-LNSA) is introduced, simultaneously capturing spectral correlations, local features, and nonlocal dependencies. The integration of U-LNSA into DNA-Net establishes the first Transformer-based deep unfolding method for HSI denoising. Experimental results on synthetic and real noise validate DNA-Net's superior performance over state-of-the-art (SOTA) methods. Moreover, the DNA-Net, trained exclusively on mixed Gaussian noise and impulse noise, demonstrates the ability to generalize to unseen noise present in real images. Code and models will be released at: https://github.com/NavyZeng/DNA-Net.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction
    Li, Miaoyu
    Fu, Ying
    Liu, Ji
    Zhang, Yulun
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12913 - 12922
  • [2] Hyperspectral Denoising Using Asymmetric Noise Modeling Deep Image Prior
    Wang, Yifan
    Xu, Shuang
    Cao, Xiangyong
    Ke, Qiao
    Ji, Teng-Yu
    Zhu, Xiangxiang
    REMOTE SENSING, 2023, 15 (08)
  • [3] Blind Image Denoising via Deep Unfolding Network With Degradation Information Guidance
    Qin, Man
    Ren, Chao
    Yang, Hong
    He, Xiaohai
    Wang, Zhengyong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (08) : 3179 - 3183
  • [4] Deep Unfolding Network Enhanced by Transformer Priors for Unregistered Hyperspectral and Multispectral Image Fusion
    Fang, Jian
    Yang, Jingxiang
    Khader, Abdolraheem
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] Degradation-aware deep unfolding network with transformer prior for video compressive imaging
    Yin, Jianfu
    Wang, Nan
    Hu, Binliang
    Wang, Yao
    Wang, Quan
    SIGNAL PROCESSING, 2025, 227
  • [6] IMAGE DENOISING WITH DEEP UNFOLDING AND NORMALIZING FLOWS
    Wei, Xinyi
    van Gorp, Hans
    Carabarin, Lizeth Gonzalez
    Freedman, Daniel
    Eldar, Yonina C.
    van Sloun, Ruud J. G.
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1551 - 1555
  • [7] Learning Degradation-Aware Deep Prior for Hyperspectral Image Reconstruction
    Yang, Jingxiang
    Lin, Tian
    Liu, Fang
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [8] Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoising
    Li, Miaoyu
    Liu, Ji
    Fu, Ying
    Zhang, Yulun
    Dou, Dejing
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5805 - 5814
  • [9] Spatial-Spectral Transformer for Hyperspectral Image Denoising
    Li, Miaoyu
    Fu, Ying
    Zhang, Yulun
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1368 - 1376
  • [10] Advancing Hyperspectral and Multispectral Image Fusion: An Information-Aware Transformer-Based Unfolding Network
    Sun, Jianqiao
    Chen, Bo
    Lu, Ruiying
    Cheng, Ziheng
    Qu, Chunhui
    Yuan, Xin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15