Spectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution

被引:2
|
作者
Chen, Bowen [1 ,2 ,3 ]
Liu, Liqin [1 ,3 ,4 ,6 ]
Liu, Chenyang [1 ,3 ,4 ,6 ]
Zou, Zhengxia [3 ,5 ]
Shi, Zhenwei [1 ,2 ,3 ]
机构
[1] Beihang Univ, Image Proc Ctr, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[3] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[4] Beihang Univ, Image Proc Ctr, Sch Astronaut, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Astronaut, Dept Guidance Nav & Control, Beijing 100191, Peoples R China
[6] Beihang Univ, Shen Yuan Honors Coll, Beijing 100191, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Cascade-based methods; diffusion model; remote sensing; spectral super-resolution; NETWORK;
D O I
10.1109/TGRS.2024.3450874
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral remote sensing images (HSIs) have unique advantages in urban planning, precision agriculture, and ecology monitoring since they provide rich spectral information. However, hyperspectral imaging usually suffers from low spatial resolution and high cost, which limits the wide application of hyperspectral data. Spectral super-resolution provides a promising solution to acquire hyperspectral images with high spatial resolution and low cost, taking RGB images as input. Existing spectral super-resolution methods utilize neural networks following a single-shot framework, i.e., final results are obtained by one-stage spectral super-resolution, which struggles to capture and model the complex relationships between spectral bands. In this article, we propose a spectral-cascaded diffusion model (SCDM), a coarse-to-fine spectral super-resolution method based on the diffusion model. The diffusion model fits the real data distribution through stepwise denoising, which is naturally suitable for modeling rich spectral information. We cascade the diffusion model in the spectral dimension to gradually refine the spectral trends and enrich spectral information of the pixels. The cascade solves the highly ill-posed problem of spectral super-resolution step-by-step, mitigating the inaccuracies of previous single-shot approaches. To better utilize the potential of the diffusion model for spectral super-resolution, we design image condition mixture guidance (ICMG) to enhance the guidance of image conditions and progressive dynamic truncation (PDT) to limit cumulative errors in the sampling process. Experimental results demonstrate that our method achieves state-of-the-art performance in spectral super-resolution. Codes can be found at https://github.com/Mr-Bamboo/SCDM.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Exploring the Spectral Prior for Hyperspectral Image Super-Resolution
    Hu, Qian
    Wang, Xinya
    Jiang, Junjun
    Zhang, Xiao-Ping
    Ma, Jiayi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5260 - 5272
  • [32] Multi-modal Spectral Image Super-Resolution
    Lahoud, Fayez
    Zhou, Ruofan
    Susstrunk, Sabine
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 35 - 50
  • [33] Denoising Diffusion Probabilistic Model with Adversarial Learning for Remote Sensing Super-Resolution
    Sui, Jialu
    Wu, Qianqian
    Pun, Man-On
    REMOTE SENSING, 2024, 16 (07)
  • [34] UNet-ESPC-Cascaded Super-Resolution Reconstruction in Spectral CT
    Li, Zhouxia
    Wang, Xiaoni
    Wang, Lihui
    Ji, Wen
    Zhang, Miaomiao
    Zhu, Yuemin
    Yang, Feng
    PROCEEDINGS OF 2020 IEEE 15TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2020), 2020, : 515 - 519
  • [35] Latent spectral-spatial diffusion model for single hyperspectral super-resolution
    Cheng, Yingsong
    Ma, Yong
    Fan, Fan
    Ma, Jiayi
    Yao, Yuan
    Mei, Xiaoguang
    GEO-SPATIAL INFORMATION SCIENCE, 2024,
  • [36] Quantization for Spectral Super-Resolution
    Gunturk, C. Sinan
    Li, Weilin
    CONSTRUCTIVE APPROXIMATION, 2022, 56 (03) : 619 - 648
  • [37] Spatial-Spectral Aggregation Transformer With Diffusion Prior for Hyperspectral Image Super-Resolution
    Zhang, Mingyang
    Wang, Xiangyu
    Wu, Shuang
    Wang, Zhaoyang
    Gong, Maoguo
    Zhou, Yu
    Jiang, Fenlong
    Wu, Yue
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (04) : 3557 - 3572
  • [38] Quantization for Spectral Super-Resolution
    C. Sinan Güntürk
    Weilin Li
    Constructive Approximation, 2022, 56 : 619 - 648
  • [39] A super-resolution model and algorithm of remote sensing image based on sparse representation
    Zhong, J. (zhongjiusheng@sina.com), 1600, SinoMaps Press (43):
  • [40] Single Remote Sensing Image Super-Resolution with an Adaptive Joint Constraint Model
    Fu, Lingli
    Ren, Chao
    He, Xiaohai
    Wu, Xiaohong
    Wang, Zhengyong
    SENSORS, 2020, 20 (05)