Multiscale Spatial-Frequency Domain Dynamic Pansharpening of Remote Sensing Images Integrated With Wavelet Transform

被引:2
|
作者
Li, Yingjie [1 ]
Jin, Weiqi [1 ]
Qiu, Su [1 ]
He, Yuqing [1 ]
机构
[1] Beijing Inst Technol, MOE Key Lab Optoelect Imaging Technol & Syst, Beijing 100081, Peoples R China
关键词
Deep learning (DL); dynamic filtering; frequency domain; pansharpening; wavelet transform; FUSION; QUALITY; MS;
D O I
10.1109/TGRS.2024.3463669
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Pansharpening produces high-resolution multispectral (HRMS) images by enhancing the high-frequency details in multispectral (MS) images, with deep learning (DL) methods emerging as a new paradigm. However, most existing DL methods primarily focus on pansharpening in the spatial domain using convolutional layers with local kernels, which is not conducive to accurate reconstruction of global high frequencies, leading to spatial deformation and spectral distortion. To address this issue, we propose a bidirectional progressive spatial-frequency dynamic fusion network that constructs a multiscale structure using wavelet transform. This network utilizes the wavelet transform's ability to analyze frequency information in local neighborhoods to inject high frequencies from panchromatic (PAN) images into MS images. Additionally, it employs a wavelet-based adaptive fusion module to analyze spatial-spectral correlations and adaptively learn the injection gains for high-frequency details, thereby enhancing spectral fidelity. To further adapt to various scenarios, a dual-domain dynamic filtering (D3F) block is proposed. It improves model generalization through data-specific dynamic filtering in both frequency and spatial domains, capturing global and local dependencies effectively. Quantitative metrics and visualization results on reduced and full-resolution images demonstrate that our method outperforms other advanced methods with low-computational cost, producing high-fidelity HRMS images.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] SPATIAL-FREQUENCY NETWORK FOR SEGMENTATION OF REMOTE SENSING IMAGES
    Zhang, Tony
    Dick, Robert P.
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3553 - 3557
  • [2] An Explainable Spatial-Frequency Multiscale Transformer for Remote Sensing Scene Classification
    Yang, Yuting
    Jiao, Licheng
    Liu, Fang
    Liu, Xu
    Li, Lingling
    Chen, Puhua
    Yang, Shuyuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] MSFNet: Multiscale Spatial-Frequency Feature Fusion Network for Remote Sensing Change Detection
    Guo, Zhixiang
    Chen, Hao
    He, Fachuan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 1912 - 1925
  • [4] Channel Self-Attention Based Multiscale Spatial-Frequency Domain Network for Oriented Object Detection in Remote Sensing Imagery
    Xu, Yang
    Pan, Yushan
    Wu, Zebin
    Wei, Zhihui
    Zhan, Tianming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] Filtering theory and application of wavelet optics at the spatial-frequency domain
    Tan, LY
    Ma, J
    Wang, Q
    Ran, QW
    APPLIED OPTICS, 2001, 40 (02) : 257 - 260
  • [6] Spatial frequency discrete wavelet transform image fusion technique for remote sensing applications
    Jinju, Joy
    Santhi, N.
    Ramar, K.
    Bama, B. Sathya
    ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2019, 22 (03): : 715 - 726
  • [7] From Spatial to Frequency Domain: A Pure Frequency Domain FDNet Model for the Classification of Remote Sensing Images
    Wang, Wei
    Yang, Tianle
    Wang, Xin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [8] Pansharpening Based on Spectral-Spatial Dependence for Multibands Remote Sensing Images
    Wu, Lei
    Jiang, Xunyan
    IEEE ACCESS, 2022, 10 : 76153 - 76167
  • [9] A Mosaic Approach for Remote Sensing Images Based on Wavelet Transform
    Cheng, Yuanhang
    Han, Xiaowei
    Xue, Dingyu
    2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, : 3218 - +
  • [10] Fractional Fourier transform for elliptical Gaussian beam in spatial-frequency domain
    Cai, YJ
    Lin, Q
    OPTIK, 2003, 114 (10): : 433 - 436