Multiscale Spatial-Frequency Domain Dynamic Pansharpening of Remote Sensing Images Integrated With Wavelet Transform

被引:2
|
作者
Li, Yingjie [1 ]
Jin, Weiqi [1 ]
Qiu, Su [1 ]
He, Yuqing [1 ]
机构
[1] Beijing Inst Technol, MOE Key Lab Optoelect Imaging Technol & Syst, Beijing 100081, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Deep learning (DL); dynamic filtering; frequency domain; pansharpening; wavelet transform; FUSION; QUALITY; MS;
D O I
10.1109/TGRS.2024.3463669
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Pansharpening produces high-resolution multispectral (HRMS) images by enhancing the high-frequency details in multispectral (MS) images, with deep learning (DL) methods emerging as a new paradigm. However, most existing DL methods primarily focus on pansharpening in the spatial domain using convolutional layers with local kernels, which is not conducive to accurate reconstruction of global high frequencies, leading to spatial deformation and spectral distortion. To address this issue, we propose a bidirectional progressive spatial-frequency dynamic fusion network that constructs a multiscale structure using wavelet transform. This network utilizes the wavelet transform's ability to analyze frequency information in local neighborhoods to inject high frequencies from panchromatic (PAN) images into MS images. Additionally, it employs a wavelet-based adaptive fusion module to analyze spatial-spectral correlations and adaptively learn the injection gains for high-frequency details, thereby enhancing spectral fidelity. To further adapt to various scenarios, a dual-domain dynamic filtering (D3F) block is proposed. It improves model generalization through data-specific dynamic filtering in both frequency and spatial domains, capturing global and local dependencies effectively. Quantitative metrics and visualization results on reduced and full-resolution images demonstrate that our method outperforms other advanced methods with low-computational cost, producing high-fidelity HRMS images.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Toward Evaluating Multiscale Segmentations of High Spatial Resolution Remote Sensing Images
    Zhang, Xueliang
    Xiao, Pengfeng
    Feng, Xuezhi
    Feng, Li
    Ye, Nan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (07): : 3694 - 3706
  • [32] Road Identification Algorithm for Remote Sensing Images Based on Wavelet Transform and Recursive Operator
    Chen Guobin
    Sun, Zengwu
    Li Zhang
    IEEE ACCESS, 2020, 8 : 141824 - 141837
  • [33] Fusing remote sensing images using a trous wavelet transform and empirical mode decomposition
    Chen, Shao-hui
    Su, Hongbo
    Zhang, Renhua
    Tian, Jing
    PATTERN RECOGNITION LETTERS, 2008, 29 (03) : 330 - 342
  • [34] A SELF-ADAPTIVE SPATIAL-FREQUENCY DOMAIN CONJOINT WATERMARKING ALGORITHM FOR BINARY IMAGES
    Ma, Yide
    Lin, Dongmei
    Zhang, Hongjuan
    Zhang, Zaifeng
    Wang, Xiaoyan
    Su, Maojun
    ICSPC: 2007 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS, VOLS 1-3, PROCEEDINGS, 2007, : 752 - 755
  • [35] Discrete stationary wavelet transform based saliency information fusion from frequency and spatial domain in low contrast images
    Mu, Nan
    Xu, Xin
    Zhang, Xiaolong
    Lin, Xiaoli
    PATTERN RECOGNITION LETTERS, 2018, 115 : 84 - 91
  • [36] Spatial reasoning and multiscale segmentation for object recognition in HR optical remote sensing images
    Inglada, Jordi
    Michel, Julien
    IGARSS: 2007 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-12: SENSING AND UNDERSTANDING OUR PLANET, 2007, : 4798 - +
  • [37] Boundary-Aware Spatial and Frequency Dual-Domain Transformer for Remote Sensing Urban Images Segmentation
    Zhang, Jie
    Shao, Mingwen
    Wan, Yecong
    Meng, Lingzhuang
    Cao, Xiangyong
    Wang, Shuigen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 1
  • [38] Road Extraction from High-Resolution Remote Sensing Images Using Wavelet Transform and Hough Transform
    Yang, Xiaoliang
    Wen, Gongjian
    2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), 2012, : 1095 - 1099
  • [39] Wavelet Integrated Convolutional Neural Network for Thin Cloud Removal in Remote Sensing Images
    Zi, Yue
    Ding, Haidong
    Xie, Fengying
    Jiang, Zhiguo
    Song, Xuedong
    REMOTE SENSING, 2023, 15 (03)
  • [40] The Practice of an Automatic Registration System based on Contour Features and Wavelet Transform for Remote Sensing Images
    Meddeber, L.
    Berrached, N. E.
    Taleb-Ahmed, A.
    SECOND INTERNATIONAL CONFERENCE ON COMPUTER AND ELECTRICAL ENGINEERING, VOL 2, PROCEEDINGS, 2009, : 58 - +