Multiscale Spatial-Frequency Domain Dynamic Pansharpening of Remote Sensing Images Integrated With Wavelet Transform

被引:2
|
作者
Li, Yingjie [1 ]
Jin, Weiqi [1 ]
Qiu, Su [1 ]
He, Yuqing [1 ]
机构
[1] Beijing Inst Technol, MOE Key Lab Optoelect Imaging Technol & Syst, Beijing 100081, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Deep learning (DL); dynamic filtering; frequency domain; pansharpening; wavelet transform; FUSION; QUALITY; MS;
D O I
10.1109/TGRS.2024.3463669
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Pansharpening produces high-resolution multispectral (HRMS) images by enhancing the high-frequency details in multispectral (MS) images, with deep learning (DL) methods emerging as a new paradigm. However, most existing DL methods primarily focus on pansharpening in the spatial domain using convolutional layers with local kernels, which is not conducive to accurate reconstruction of global high frequencies, leading to spatial deformation and spectral distortion. To address this issue, we propose a bidirectional progressive spatial-frequency dynamic fusion network that constructs a multiscale structure using wavelet transform. This network utilizes the wavelet transform's ability to analyze frequency information in local neighborhoods to inject high frequencies from panchromatic (PAN) images into MS images. Additionally, it employs a wavelet-based adaptive fusion module to analyze spatial-spectral correlations and adaptively learn the injection gains for high-frequency details, thereby enhancing spectral fidelity. To further adapt to various scenarios, a dual-domain dynamic filtering (D3F) block is proposed. It improves model generalization through data-specific dynamic filtering in both frequency and spatial domains, capturing global and local dependencies effectively. Quantitative metrics and visualization results on reduced and full-resolution images demonstrate that our method outperforms other advanced methods with low-computational cost, producing high-fidelity HRMS images.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Wavelet packet compression algorithm for remote sensing images with extended spatial orientation tree
    Mi, De-Ling
    Feng, Peng
    Wei, Biao
    Pan, Ying-Jun
    Jin, Wei
    Guangdian Gongcheng/Opto-Electronic Engineering, 2008, 35 (01): : 94 - 99
  • [42] A novel algorithm based on wavelet transform for ship target detection in optical remote sensing images
    Huang, Bo
    Xu, Tingfa
    Chen, Sining
    Huang, Tingting
    NINTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2017), 2017, 10420
  • [43] A fusion method of panchromatic and multi-spectral remote sensing images based on wavelet transform
    Xue X.
    Xiang F.
    Wang H.
    Journal of Computational and Theoretical Nanoscience, 2016, 13 (02) : 1479 - 1485
  • [44] An Automatic Registration and Mosaicking System based on Contour Features and Wavelet Transform for Remote Sensing Images
    Meddeber, L.
    Berrached, N. E.
    Taleb-Ahmed, A.
    2009 3RD INTERNATIONAL CONFERENCE ON SIGNALS, CIRCUITS AND SYSTEMS (SCS 2009), 2009, : 752 - +
  • [45] SPATIAL-FREQUENCY DOMAIN TECHNIQUE - AN APPROACH FOR ANALYZING THE SCANNING LASER ACOUSTIC MICROSCOPE INTERFEROGRAM IMAGES
    TERVOLA, KMU
    OBRIEN, WD
    IEEE TRANSACTIONS ON SONICS AND ULTRASONICS, 1985, 32 (04): : 544 - 554
  • [46] Remote sensing image fusion for different spectral and spatial resolutions with bilinear resampling wavelet transform
    Zhou, QX
    Jing, ZL
    Jiang, SZ
    FUSION 2003: PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE OF INFORMATION FUSION, VOLS 1 AND 2, 2003, : 185 - 192
  • [47] Remote sensing image fusion for different spectral and spatial resolutions with bilinear resampling wavelet transform
    Zhou, QX
    Jing, ZL
    Jiang, SZ
    2003 IEEE INTELLIGENT TRANSPORTATION SYSTEMS PROCEEDINGS, VOLS. 1 & 2, 2003, : 1206 - 1213
  • [48] Modified multiscale fusion combing wavelet-domain HMT model for remote sensing image segmentation
    Sun, Wen-Feng
    Sun, Qiang
    Jiao, Li-Cheng
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2004, 33 (05): : 528 - 532
  • [49] Multi-Scale Frequency-Spatial Domain Attention Fusion Network for Building Extraction in Remote Sensing Images
    Liu, Jia
    Chen, Hao
    Li, Zuhe
    Gu, Hang
    ELECTRONICS, 2024, 13 (23):
  • [50] Dual-Domain Fusion Network Based on Wavelet Frequency Decomposition and Fuzzy Spatial Constraint for Remote Sensing Image Segmentation
    Wei, Guangyi
    Xu, Jindong
    Yan, Weiqing
    Chong, Qianpeng
    Xing, Haihua
    Ni, Mengying
    REMOTE SENSING, 2024, 16 (19)