Spectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution

被引:2
|
作者
Chen, Bowen [1 ,2 ,3 ]
Liu, Liqin [1 ,3 ,4 ,6 ]
Liu, Chenyang [1 ,3 ,4 ,6 ]
Zou, Zhengxia [3 ,5 ]
Shi, Zhenwei [1 ,2 ,3 ]
机构
[1] Beihang Univ, Image Proc Ctr, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[3] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[4] Beihang Univ, Image Proc Ctr, Sch Astronaut, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Astronaut, Dept Guidance Nav & Control, Beijing 100191, Peoples R China
[6] Beihang Univ, Shen Yuan Honors Coll, Beijing 100191, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Cascade-based methods; diffusion model; remote sensing; spectral super-resolution; NETWORK;
D O I
10.1109/TGRS.2024.3450874
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral remote sensing images (HSIs) have unique advantages in urban planning, precision agriculture, and ecology monitoring since they provide rich spectral information. However, hyperspectral imaging usually suffers from low spatial resolution and high cost, which limits the wide application of hyperspectral data. Spectral super-resolution provides a promising solution to acquire hyperspectral images with high spatial resolution and low cost, taking RGB images as input. Existing spectral super-resolution methods utilize neural networks following a single-shot framework, i.e., final results are obtained by one-stage spectral super-resolution, which struggles to capture and model the complex relationships between spectral bands. In this article, we propose a spectral-cascaded diffusion model (SCDM), a coarse-to-fine spectral super-resolution method based on the diffusion model. The diffusion model fits the real data distribution through stepwise denoising, which is naturally suitable for modeling rich spectral information. We cascade the diffusion model in the spectral dimension to gradually refine the spectral trends and enrich spectral information of the pixels. The cascade solves the highly ill-posed problem of spectral super-resolution step-by-step, mitigating the inaccuracies of previous single-shot approaches. To better utilize the potential of the diffusion model for spectral super-resolution, we design image condition mixture guidance (ICMG) to enhance the guidance of image conditions and progressive dynamic truncation (PDT) to limit cumulative errors in the sampling process. Experimental results demonstrate that our method achieves state-of-the-art performance in spectral super-resolution. Codes can be found at https://github.com/Mr-Bamboo/SCDM.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] An Example-based Super-Resolution Algorithm for Multi-Spectral Remote Sensing Images
    Hans, W. Jino
    Merlin, Lysiya S.
    Venkateswaran, N.
    Priya, Divya T.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (09) : 318 - 323
  • [42] A Cascaded Spectral-Spatial CNN Model for Super-Resolution River Mapping With MODIS Imagery
    Yin, Zhixiang
    Ling, Feng
    Li, Xinyan
    Cai, Xiaobin
    Chi, Hong
    Li, Xiaodong
    Wang, Lihui
    Zhang, Yihang
    Du, Yun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [43] Remote sensing image super-resolution using deep-shallow cascaded convolutional neural networks
    He, Haiqing
    Chen, Ting
    Chen, Minqiang
    Li, Dajun
    Cheng, Penggen
    SENSOR REVIEW, 2019, 39 (05) : 629 - 635
  • [44] Single Image Super-Resolution with Application to Remote-Sensing Image
    Deeba, Farah
    Dharejo, Fayaz Ali
    Zhou, Yuanchun
    Ghaffar, Abdul
    Memon, Mujahid Hussain
    Kun, She
    2020 GLOBAL CONFERENCE ON WIRELESS AND OPTICAL TECHNOLOGIES (GCWOT), 2020,
  • [45] Efficient Swin Transformer for Remote Sensing Image Super-Resolution
    Kang, Xudong
    Duan, Puhong
    Li, Jier
    Li, Shutao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6367 - 6379
  • [46] A super resolution approach for spectral unmixing of remote sensing images
    Li, Xi
    Tian, Liqiao
    Zhao, Xi
    Chen, Xiaoling
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2011, 32 (21) : 6091 - 6107
  • [47] Saliency-Guided Remote Sensing Image Super-Resolution
    Liu, Baodi
    Zhao, Lifei
    Li, Jiaoyue
    Zhao, Hengle
    Liu, Weifeng
    Li, Ye
    Wang, Yanjiang
    Chen, Honglong
    Cao, Weijia
    REMOTE SENSING, 2021, 13 (24)
  • [48] Information Purification Network for Remote Sensing Image Super-Resolution
    Wang, Zheyuan
    Li, Liangliang
    Xing, Linxin
    Wang, Jiawen
    Sun, Kaipeng
    Ma, Hongbing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2023, 28 (02): : 310 - 321
  • [49] Coupled Adversarial Training for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Zou, Zhengxia
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3633 - 3643
  • [50] Uniqueness theory for model sets, and spectral super-resolution
    Benedetto, John J.
    Zhao, Chenzhi
    RENDICONTI LINCEI-MATEMATICA E APPLICAZIONI, 2021, 32 (01) : 109 - 133