MBGPIN: Multi-Branch Generative Prior Integration Network for Super-Resolution Satellite Imagery

被引:1
|
作者
Safarov, Furkat [1 ]
Khojamuratova, Ugiloy [2 ]
Komoliddin, Misirov [3 ]
Bolikulov, Furkat [1 ]
Muksimova, Shakhnoza [1 ]
Cho, Young-Im [1 ]
机构
[1] Gachon Univ, Dept Comp Engn, Seongnam Si 461701, South Korea
[2] CUNY Queens Coll, Dept Comp Sci, 65-30 Kissena Blvd Flushing, New York, NY 11374 USA
[3] Tashkent State Univ Econ, Dept Financial Accounting & Reporting, Tashkent 100066, Uzbekistan
关键词
satellite image super-resolution; multi-branch generative prior integration network; adaptive generative prior fusion; remote sensing; high-frequency detail recovery;
D O I
10.3390/rs17050805
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Achieving super-resolution with satellite images is a critical task for enhancing the utility of remote sensing data across various applications, including urban planning, disaster management, and environmental monitoring. Traditional interpolation methods often fail to recover fine details, while deep-learning-based approaches, including convolutional neural networks (CNNs) and generative adversarial networks (GANs), have significantly advanced super-resolution performance. Recent studies have explored large-scale models, such as Transformer-based architectures and diffusion models, demonstrating improved texture realism and generalization across diverse datasets. However, these methods frequently have high computational costs and require extensive datasets for training, making real-world deployment challenging. We propose the multi-branch generative prior integration network (MBGPIN) to address these limitations. This novel framework integrates multiscale feature extraction, hybrid attention mechanisms, and generative priors derived from pretrained VQGAN models. The dual-pathway architecture of the MBGPIN includes a feature extraction pathway for spatial features and a generative prior pathway for external guidance, dynamically fused using an adaptive generative prior fusion (AGPF) module. Extensive experiments on benchmark datasets such as UC Merced, NWPU-RESISC45, and RSSCN7 demonstrate that the MBGPIN achieves superior performance compared to state-of-the-art methods, including large-scale super-resolution models. The MBGPIN delivers a higher peak signal-to-noise ratio (PSNR) and higher structural similarity index measure (SSIM) scores while preserving high-frequency details and complex textures. The model also achieves significant computational efficiency, with reduced floating point operations (FLOPs) and faster inference times, making it scalable for real-world applications.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] The Effects of Super-Resolution on Object Detection Performance in Satellite Imagery
    Shermeyer, Jacob
    Van Etten, Adam
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1432 - 1441
  • [42] Generative Adversarial Networks based Super Resolution of Satellite Aircraft Imagery
    Chin, Jonathan
    Mehmood, Asif
    PATTERN RECOGNITION AND TRACKING XXX, 2019, 10995
  • [43] Multi-branch aware module with channel shuffle pixel-wise attention for lightweight image super-resolution
    Xiang Gao
    Lijuan Xu
    Fan Wang
    Xiaopeng Hu
    Multimedia Systems, 2023, 29 : 289 - 303
  • [44] Super-Resolution Reconstruction Algorithm of Images Based on Improved Enhanced Super-Resolution Generative Adversarial Network
    Xin Yuanxue
    Zhu Fengting
    Shi Pengfei
    Yang Xin
    Zhou Runkang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (04)
  • [45] MrSARP: A Hierarchical Deep Generative Prior for SAR Image Super-resolution
    Agarwal, Tushar
    Sugavanam, Nithin
    Ertin, Emre
    2023 IEEE RADAR CONFERENCE, RADARCONF23, 2023,
  • [46] Learning Generative Structure Prior for Blind Text Image Super-resolution
    Li, Xiaoming
    Zuo, Wangmeng
    Loy, Chen Change
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10103 - 10113
  • [47] Multi-branch aware module with channel shuffle pixel-wise attention for lightweight image super-resolution
    Gao, Xiang
    Xu, Lijuan
    Wang, Fan
    Hu, Xiaopeng
    MULTIMEDIA SYSTEMS, 2023, 29 (01) : 289 - 303
  • [48] Arbitrary Scale Super Resolution Network for Satellite Imagery
    Jing Fang
    Jing Xiao
    Xu Wang
    Dan Chen
    Ruimin Hu
    China Communications, 2022, 19 (08) : 234 - 246
  • [49] Arbitrary Scale Super Resolution Network for Satellite Imagery
    Fang, Jing
    Xiao, Jing
    Wang, Xu
    Chen, Dan
    Hu, Ruimin
    CHINA COMMUNICATIONS, 2022, 19 (08) : 234 - 246
  • [50] Multi-Branch Deep Learning Framework for Land Scene Classification in Satellite Imagery
    Khan, Sultan Daud
    Basalamah, Saleh
    REMOTE SENSING, 2023, 15 (13)