A Single Image High-Perception Super-Resolution Reconstruction Method Based on Multi-layer Feature Fusion Model with Adaptive Compression and Parameter Tuning

被引:0
|
作者
Zhang, Rui [1 ,2 ]
Ren, Wenyu [1 ]
Pan, Lihu [1 ]
Bai, Xiaolu [1 ]
Li, Ji [1 ]
机构
[1] Taiyuan Univ Sci & Technol, Coll Comp Sci & Technol, Taiyuan 030024, Peoples R China
[2] Shanxi Prov Engn Res Ctr Equipment Digitizat & PH, Taiyuan 030024, Shanxi, Peoples R China
关键词
Multi-layer fusion super-resolution; Refine layering; Edge enhancement; Adaptive parameter tuning; Model of compression;
D O I
10.1007/s11063-024-11660-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a simple image high-perception super-resolution reconstruction method based on multi-layer feature fusion model with adaptive compression and parameter tuning. The aim is to further balance the high and low-frequency information of an image, enrich the detailed texture to improve perceptual quality, and improve the adaptive optimization and generalization of the model in the process of super-resolution reconstruction. First, an effective multi-layer fusion super-resolution (MFSR) basic model is constructed by the design of edge enhancement, refine layering, enhanced super-resolution generative adversarial network and other sub-models, and effective multi-layer fusion. This further enriches the image representation of features of different scales and depths and improves the feature representation of high and low-frequency information in a balanced way. Next, a total loss function of the generator is constructed with adaptive parameter tuning performance. The overall adaptability of the model is improved through adaptive weight distribution and fusion of content loss, perceptual loss, and adversarial loss, and improving the error while reducing the edge enhancement model. Finally, a fitness function with the evaluation perceptual function as the optimization strategy is constructed, and the model compression and adaptive tuning of MFSR are carried out based on the multi-mechanism fusion strategy. Consequently, the construction of the adaptive MFSR model is realized. Adaptive MFSR can maintain high peak signal to noise ratio and structural similarity on the test sets Set5, Set14, and BSD100, and achieve high-quality reconstructed images with low learned perceptual image patch similarity and perceptual index, while having good generalization capabilities.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Super-Resolution Reconstruction Method of Remote Sensing Image Based on Multi-Feature Fusion
    Huang, Zhi-Xing
    Jing, Chang-Wei
    IEEE ACCESS, 2020, 8 : 18764 - 18771
  • [2] A Single Image Super-Resolution Reconstruction Based on Fusion
    Su Jin-sheng
    Zhang Ming-jun
    Yu Wen-jing
    THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083
  • [3] Multi-layer strategy and reconstruction model with low rank and local rank regularizations for single image super-resolution
    Gong, Weiguo
    Yi, Qiane
    Tang, Yongliang
    Li, Weihong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2017, 57 : 197 - 210
  • [4] Image Super-Resolution Reconstruction based on Adaptive Secletion Regularization Parameter
    Zhang, Xiu
    Zhou, Wei
    Duan, Zhemin
    PROCEEDINGS OF THE 2017 12TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2017, : 1195 - 1199
  • [5] A Lightweight Pyramid Feature Fusion Network for Single Image Super-Resolution Reconstruction
    Liu, Bingzan
    Ning, Xin
    Ma, Shichao
    Lian, Xiaobin
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1575 - 1579
  • [6] Single-image super-resolution reconstruction based on phase-aware visual multi-layer perceptron (MLP)
    Shi, Changteng
    Li, Mengjun
    An, Zhiyong
    PeerJ Computer Science, 2024, 10
  • [7] Single-image super-resolution reconstruction based on phase-aware visual multi-layer perceptron (MLP)
    Shi, Changteng
    Li, Mengjun
    An, Zhiyong
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [8] Multi-level Feature Fusion Network for Single Image Super-Resolution
    Zhang, Xinxia
    Zhang, Xiaoqin
    Zhao, Li
    Jiang, Runhua
    Huang, Pengcheng
    Xu, Jiawei
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3361 - 3368
  • [9] Multi-level Feature Fusion Mechanism for Single Image Super-Resolution
    Lyn, Jiawen
    2020 THE 3RD INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTICS AND CONTROL ENGINEERING (IRCE 2020), 2020, : 52 - 57
  • [10] Multi-feature fusion attention network for single image super-resolution
    Chen, Jiacheng
    Wang, Wanliang
    Xing, Fangsen
    Tu, Hangyao
    IET IMAGE PROCESSING, 2023, 17 (05) : 1389 - 1402