MBGPIN: Multi-Branch Generative Prior Integration Network for Super-Resolution Satellite Imagery

被引:1
|
作者
Safarov, Furkat [1 ]
Khojamuratova, Ugiloy [2 ]
Komoliddin, Misirov [3 ]
Bolikulov, Furkat [1 ]
Muksimova, Shakhnoza [1 ]
Cho, Young-Im [1 ]
机构
[1] Gachon Univ, Dept Comp Engn, Seongnam Si 461701, South Korea
[2] CUNY Queens Coll, Dept Comp Sci, 65-30 Kissena Blvd Flushing, New York, NY 11374 USA
[3] Tashkent State Univ Econ, Dept Financial Accounting & Reporting, Tashkent 100066, Uzbekistan
关键词
satellite image super-resolution; multi-branch generative prior integration network; adaptive generative prior fusion; remote sensing; high-frequency detail recovery;
D O I
10.3390/rs17050805
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Achieving super-resolution with satellite images is a critical task for enhancing the utility of remote sensing data across various applications, including urban planning, disaster management, and environmental monitoring. Traditional interpolation methods often fail to recover fine details, while deep-learning-based approaches, including convolutional neural networks (CNNs) and generative adversarial networks (GANs), have significantly advanced super-resolution performance. Recent studies have explored large-scale models, such as Transformer-based architectures and diffusion models, demonstrating improved texture realism and generalization across diverse datasets. However, these methods frequently have high computational costs and require extensive datasets for training, making real-world deployment challenging. We propose the multi-branch generative prior integration network (MBGPIN) to address these limitations. This novel framework integrates multiscale feature extraction, hybrid attention mechanisms, and generative priors derived from pretrained VQGAN models. The dual-pathway architecture of the MBGPIN includes a feature extraction pathway for spatial features and a generative prior pathway for external guidance, dynamically fused using an adaptive generative prior fusion (AGPF) module. Extensive experiments on benchmark datasets such as UC Merced, NWPU-RESISC45, and RSSCN7 demonstrate that the MBGPIN achieves superior performance compared to state-of-the-art methods, including large-scale super-resolution models. The MBGPIN delivers a higher peak signal-to-noise ratio (PSNR) and higher structural similarity index measure (SSIM) scores while preserving high-frequency details and complex textures. The model also achieves significant computational efficiency, with reduced floating point operations (FLOPs) and faster inference times, making it scalable for real-world applications.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Channel rearrangement multi-branch network for image super-resolution
    Wei, Deyun
    Wang, Zhaowu
    DIGITAL SIGNAL PROCESSING, 2022, 120
  • [2] Image super-resolution network based on a multi-branch attention mechanism
    Xin Yang
    Yingqing Guo
    Zhiqiang Li
    Dake Zhou
    Signal, Image and Video Processing, 2021, 15 : 1397 - 1405
  • [3] Multi-Branch Deep Residual Network for Single Image Super-Resolution
    Liu, Peng
    Hong, Ying
    Liu, Yan
    ALGORITHMS, 2018, 11 (10)
  • [4] Image super-resolution network based on a multi-branch attention mechanism
    Yang, Xin
    Guo, Yingqing
    Li, Zhiqiang
    Zhou, Dake
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (07) : 1397 - 1405
  • [5] Residual multi-branch distillation network for efficient image super-resolution
    Gao, Xiang
    Zhou, Ying
    Wu, Sining
    Wu, Xinrong
    Wang, Fan
    Hu, Xiaopeng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (30) : 75217 - 75241
  • [6] PMBANet: Progressive Multi-Branch Aggregation Network for Scene Depth Super-Resolution
    Ye, Xinchen
    Sun, Baoli
    Wang, Zhihui
    Yang, Jingyu
    Xu, Rui
    Li, Haojie
    Li, Baopu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 7427 - 7442
  • [7] A Multi-Branch Feature Extraction Residual Network for Lightweight Image Super-Resolution
    Liu, Chunying
    Wan, Xujie
    Gao, Guangwei
    MATHEMATICS, 2024, 12 (17)
  • [8] Stacked Multi-branch Networks for Single Image Super-Resolution
    Matsune, Ai
    Cheng, Guoan
    Zhan, Shu
    PROCEEDINGS OF THE WORLD CONFERENCE ON INTELLIGENT AND 3-D TECHNOLOGIES, WCI3DT 2022, 2023, 323 : 407 - 417
  • [9] Super-resolution of digital rock images with hybrid attention multi-branch neural network
    Yang, Yongfei
    Wang, Jinye
    Liu, Fugui
    Zhang, Lei
    Sun, Hai
    Zhong, Junjie
    Zhang, Kai
    Yao, Jun
    GAS SCIENCE AND ENGINEERING, 2024, 128
  • [10] Single-image super-resolution based on multi-branch residual pyramid network
    Ou, Jiayu
    Xia, Hao
    Huo, Wenxiao
    Yan, Yejin
    Li, Tianping
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (06) : 2569 - 2581