Multiscale Dual-Domain Guidance Network for Pan-Sharpening

The goal of pan-sharpening is to produce a high-spatial-resolution multispectral (HRMS) image from a low-spatial-resolution multispectral (LRMS) counterpart by super-resolving the LRMS one under the guidance of a texture-rich panchromatic (PAN) image. Existing research has concentrated on using spatial information to generate HRMS images, but has neglected to investigate the frequency domain, which severely restricts the performance improvement. In this work, we propose a novel pan-sharpening approach, named multiscale dual-domain guidance network (MSDDN) by fully exploring and exploiting the distinguished information in both the spatial and frequency domains. Specifically, the network is inborn with multiscale U-shape manner and composed by two core parts: a spatial guidance subnetwork for fusing local spatial information and a frequency guidance subnetwork for fusing global frequency domain information and encouraging dual-domain complementary learning. In this way, the model can capture multiscale dual-domain information to help it generate high-quality pan-sharpening results. Employing the proposed model on different datasets, the quantitative and qualitative results demonstrate that our method performs appreciatively against other state-of-the-art (SOTA) approaches and comprises a strong generalization ability for real-world scenes. The source code is available at https://github.com/alexhe101/MSDDN.