MBGPIN: Multi-Branch Generative Prior Integration Network for Super-Resolution Satellite Imagery

被引:1
|
作者
Safarov, Furkat [1 ]
Khojamuratova, Ugiloy [2 ]
Komoliddin, Misirov [3 ]
Bolikulov, Furkat [1 ]
Muksimova, Shakhnoza [1 ]
Cho, Young-Im [1 ]
机构
[1] Gachon Univ, Dept Comp Engn, Seongnam Si 461701, South Korea
[2] CUNY Queens Coll, Dept Comp Sci, 65-30 Kissena Blvd Flushing, New York, NY 11374 USA
[3] Tashkent State Univ Econ, Dept Financial Accounting & Reporting, Tashkent 100066, Uzbekistan
关键词
satellite image super-resolution; multi-branch generative prior integration network; adaptive generative prior fusion; remote sensing; high-frequency detail recovery;
D O I
10.3390/rs17050805
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Achieving super-resolution with satellite images is a critical task for enhancing the utility of remote sensing data across various applications, including urban planning, disaster management, and environmental monitoring. Traditional interpolation methods often fail to recover fine details, while deep-learning-based approaches, including convolutional neural networks (CNNs) and generative adversarial networks (GANs), have significantly advanced super-resolution performance. Recent studies have explored large-scale models, such as Transformer-based architectures and diffusion models, demonstrating improved texture realism and generalization across diverse datasets. However, these methods frequently have high computational costs and require extensive datasets for training, making real-world deployment challenging. We propose the multi-branch generative prior integration network (MBGPIN) to address these limitations. This novel framework integrates multiscale feature extraction, hybrid attention mechanisms, and generative priors derived from pretrained VQGAN models. The dual-pathway architecture of the MBGPIN includes a feature extraction pathway for spatial features and a generative prior pathway for external guidance, dynamically fused using an adaptive generative prior fusion (AGPF) module. Extensive experiments on benchmark datasets such as UC Merced, NWPU-RESISC45, and RSSCN7 demonstrate that the MBGPIN achieves superior performance compared to state-of-the-art methods, including large-scale super-resolution models. The MBGPIN delivers a higher peak signal-to-noise ratio (PSNR) and higher structural similarity index measure (SSIM) scores while preserving high-frequency details and complex textures. The model also achieves significant computational efficiency, with reduced floating point operations (FLOPs) and faster inference times, making it scalable for real-world applications.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] VIDEO SATELLITE IMAGERY SUPER-RESOLUTION VIA A DEEP RESIDUAL NETWORK
    Wu, Jiemin
    He, Zhi
    Zhuo, Li
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2762 - 2765
  • [22] Multi-branch-feature fusion super-resolution network
    Li, Dong
    Yang, Silu
    Wang, Xiaoming
    Qin, Yu
    Zhang, Heng
    DIGITAL SIGNAL PROCESSING, 2024, 145
  • [23] Real-world super-resolution based on residual attention network with tree based multi-branch structure
    Han, Yu-Lan
    Gu, Qin
    Cui, Yu-Jie
    Lan, Chao-Feng
    Kongzhi yu Juece/Control and Decision, 2024, 39 (10): : 3442 - 3450
  • [24] Efficient Screen Content Image Super-Resolution with Weighted Multi-Branch Convolution and Attention
    Wang, Yifan
    Chen, Li
    19TH IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING, BMSB 2024, 2024, : 93 - 98
  • [25] Lightweight image super-resolution via multi-branch aware CNN and efficient transformer
    Xiang Gao
    Sining Wu
    Ying Zhou
    Xinrong Wu
    Fan Wang
    Xiaopeng Hu
    Neural Computing and Applications, 2024, 36 : 5285 - 5303
  • [26] Perceptual improvements for Super-Resolution of Satellite Imagery
    Bull, Daniel
    Lim, Nick
    Frank, Eibe
    PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [27] Lightweight image super-resolution via multi-branch aware CNN and efficient transformer
    Gao, Xiang
    Wu, Sining
    Zhou, Ying
    Wu, Xinrong
    Wang, Fan
    Hu, Xiaopeng
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (10): : 5285 - 5303
  • [28] Component Semantic Prior Guided Generative Adversarial Network for Face Super-Resolution
    Liu, Lu
    Wang, Shenghui
    Wan, Lili
    IEEE ACCESS, 2019, 7 : 77027 - 77036
  • [29] GARDEN: Generative Prior Guided Network for Scene Text Image Super-Resolution
    Kong, Yuxin
    Ma, Weihong
    Jin, Lianwen
    Xue, Yang
    DOCUMENT ANALYSIS AND RECOGNITION-ICDAR 2024, PT V, 2024, 14808 : 196 - 214
  • [30] MCWESRGAN: Improving Enhanced Super-Resolution Generative Adversarial Network for Satellite Images
    Karwowska, Kinga
    Wierzbicki, Damian
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 9886 - 9906