Multiscale Spatial-Frequency Domain Dynamic Pansharpening of Remote Sensing Images Integrated With Wavelet Transform

被引:2
|
作者
Li, Yingjie [1 ]
Jin, Weiqi [1 ]
Qiu, Su [1 ]
He, Yuqing [1 ]
机构
[1] Beijing Inst Technol, MOE Key Lab Optoelect Imaging Technol & Syst, Beijing 100081, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Deep learning (DL); dynamic filtering; frequency domain; pansharpening; wavelet transform; FUSION; QUALITY; MS;
D O I
10.1109/TGRS.2024.3463669
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Pansharpening produces high-resolution multispectral (HRMS) images by enhancing the high-frequency details in multispectral (MS) images, with deep learning (DL) methods emerging as a new paradigm. However, most existing DL methods primarily focus on pansharpening in the spatial domain using convolutional layers with local kernels, which is not conducive to accurate reconstruction of global high frequencies, leading to spatial deformation and spectral distortion. To address this issue, we propose a bidirectional progressive spatial-frequency dynamic fusion network that constructs a multiscale structure using wavelet transform. This network utilizes the wavelet transform's ability to analyze frequency information in local neighborhoods to inject high frequencies from panchromatic (PAN) images into MS images. Additionally, it employs a wavelet-based adaptive fusion module to analyze spatial-spectral correlations and adaptively learn the injection gains for high-frequency details, thereby enhancing spectral fidelity. To further adapt to various scenarios, a dual-domain dynamic filtering (D3F) block is proposed. It improves model generalization through data-specific dynamic filtering in both frequency and spatial domains, capturing global and local dependencies effectively. Quantitative metrics and visualization results on reduced and full-resolution images demonstrate that our method outperforms other advanced methods with low-computational cost, producing high-fidelity HRMS images.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Object counting in remote sensing via selective spatial-frequency pyramid network
    Chen, Jinyong
    Gao, Mingliang
    Guo, Xiangyu
    Zhai, Wenzhe
    Li, Qilei
    Jeon, Gwanggil
    SOFTWARE-PRACTICE & EXPERIENCE, 2024, 54 (09): : 1754 - 1773
  • [22] Instance-Aware Spatial-Frequency Feature Fusion Detector for Oriented Object Detection in Remote-Sensing Images
    Zheng, Shangdong
    Wu, Zebin
    Xu, Yang
    Wei, Zhihui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] Spatial-Frequency Dual-Domain Feature Fusion Network for Low-Light Remote Sensing Image Enhancement
    Yao, Zishu
    Fan, Guodong
    Fan, Jinfu
    Gan, Min
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [24] Haze detection and removal in remote sensing images based on undecimated wavelet transform
    Chen, Fen
    Yan, Dongmei
    Zhao, Zhongming
    Geomatics and Information Science of Wuhan University, 2007, 32 (01) : 71 - 74
  • [25] Remote sensing images data fusion: A wavelet transform approach for urban analysis
    Fanelli, A
    Leo, A
    Ferri, M
    IEEE/ISPRS JOINT WORKSHOP ON REMOTE SENSING AND DATA FUSION OVER URBAN AREAS, 2001, : 112 - 116
  • [26] Estimating the Statistical Characteristics of Remote Sensing Big Data in the Wavelet Transform Domain
    Wang, Lizhe
    Zhong, Hui
    Ranjan, Rajiv
    Zomaya, Albert
    Liu, Peng
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2014, 2 (03) : 324 - 337
  • [27] Multiple embedding of watermarks into a spatial-frequency domain of images based on a genetic algorithm
    Melman, A. S.
    Evsutin, O. O.
    Senyukova, O. E.
    COMPUTER OPTICS, 2025, 49 (02)
  • [28] PDAF: Prompt-Driven Dynamic Adaptive Fusion Network for Pansharpening Remote Sensing Images
    Tao, Hailin
    Yuan, Genji
    Hua, Zhen
    Li, Jinjiang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 13533 - 13546
  • [29] Fractional Fourier transform and the diffraction of any misaligned optical system in spatial-frequency domain
    Zhao, DM
    Zhang, WC
    Ge, F
    Wang, SM
    OPTICS AND LASER TECHNOLOGY, 2001, 33 (07): : 443 - 447
  • [30] Adaptive Image Block Hiding Technology Based on Optical Spatial-Frequency Domain Transform
    Wang Yan
    Niu Hongwei
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (16)