A Single Image High-Perception Super-Resolution Reconstruction Method Based on Multi-layer Feature Fusion Model with Adaptive Compression and Parameter Tuning

被引:0
|
作者
Zhang, Rui [1 ,2 ]
Ren, Wenyu [1 ]
Pan, Lihu [1 ]
Bai, Xiaolu [1 ]
Li, Ji [1 ]
机构
[1] Taiyuan Univ Sci & Technol, Coll Comp Sci & Technol, Taiyuan 030024, Peoples R China
[2] Shanxi Prov Engn Res Ctr Equipment Digitizat & PH, Taiyuan 030024, Shanxi, Peoples R China
关键词
Multi-layer fusion super-resolution; Refine layering; Edge enhancement; Adaptive parameter tuning; Model of compression;
D O I
10.1007/s11063-024-11660-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a simple image high-perception super-resolution reconstruction method based on multi-layer feature fusion model with adaptive compression and parameter tuning. The aim is to further balance the high and low-frequency information of an image, enrich the detailed texture to improve perceptual quality, and improve the adaptive optimization and generalization of the model in the process of super-resolution reconstruction. First, an effective multi-layer fusion super-resolution (MFSR) basic model is constructed by the design of edge enhancement, refine layering, enhanced super-resolution generative adversarial network and other sub-models, and effective multi-layer fusion. This further enriches the image representation of features of different scales and depths and improves the feature representation of high and low-frequency information in a balanced way. Next, a total loss function of the generator is constructed with adaptive parameter tuning performance. The overall adaptability of the model is improved through adaptive weight distribution and fusion of content loss, perceptual loss, and adversarial loss, and improving the error while reducing the edge enhancement model. Finally, a fitness function with the evaluation perceptual function as the optimization strategy is constructed, and the model compression and adaptive tuning of MFSR are carried out based on the multi-mechanism fusion strategy. Consequently, the construction of the adaptive MFSR model is realized. Adaptive MFSR can maintain high peak signal to noise ratio and structural similarity on the test sets Set5, Set14, and BSD100, and achieve high-quality reconstructed images with low learned perceptual image patch similarity and perceptual index, while having good generalization capabilities.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion
    Kou, Qiqi
    Zhao, Jiamin
    Cheng, Deqiang
    Su, Zhen
    Zhu, Xingguang
    IEEE ACCESS, 2023, 11 : 59530 - 59541
  • [32] Single image super-resolution reconstruction based on multi-directionality of the edge
    Liu, Jing
    Xue, Rui
    Li, Yuesong
    ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2019), 2019, 11179
  • [33] Single Image Super-Resolution Based on Global Dense Feature Fusion Convolutional Network
    Xu, Wang
    Chen, Renwen
    Huang, Bin
    Zhang, Xiang
    Liu, Chuan
    SENSORS, 2019, 19 (02)
  • [34] Image super-resolution reconstruction based on multi-scale feature mapping network
    Duan R.
    Zhou D.-W.
    Zhao L.-J.
    Chai X.-L.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2019, 53 (07): : 1331 - 1339
  • [35] Lightweight single image super-resolution based on multi-path progressive feature fusion and attention mechanism
    Shanshan Li
    Dengwen Zhou
    Yukai Liu
    Dandan Gao
    Wanjun Wang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3517 - 3528
  • [36] Lightweight single image super-resolution based on multi-path progressive feature fusion and attention mechanism
    Li, Shanshan
    Zhou, Dengwen
    Liu, Yukai
    Gao, Dandan
    Wang, Wanjun
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (10) : 3517 - 3528
  • [37] Adaptive feature denoising based deep convolutional network for single image super-resolution
    Cheng, Rui
    Wu, Yuzhe
    Wang, Jia
    Ma, Mingming
    Niu, Yi
    Shi, Guangming
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 223
  • [38] A Novel PDE-Based Single Image Super-Resolution Reconstruction Method
    Zhao, Xiaodong
    Cao, Jianzhong
    Zhou, Zuofeng
    Huang, Jijiang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2017, 31 (06)
  • [39] A Multi-Scale Recursive Attention Feature Fusion Network for Image Super-Resolution Reconstruction Algorithm
    Han, Xiaowei
    Wang, Lei
    Wang, Xiaopeng
    Zhang, Pengchao
    Xu, Haoran
    SENSORS, 2023, 23 (23)
  • [40] Image super-resolution using multi-level high-frequency feature fusion
    Cai, Zhiyuan
    Xiaol, Junsheng
    2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 737 - 742