High-Magnification Super-Resolution Reconstruction of Image with Multi-Task Learning

被引:3
|
作者
Li, Yanghui [1 ]
Zhu, Hong [1 ]
Yu, Shunyuan [2 ]
机构
[1] Xian Univ Technol, Fac Automat & Informat Engn, Xian 710048, Peoples R China
[2] Ankang Univ, Inst Elect & Informat Engn, Ankang 725000, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; high-magnification; single-image super-resolution; convolutional neural network; QUALITY ASSESSMENT; NETWORK;
D O I
10.3390/electronics11091412
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single-image super-resolution technology has made great progress with the development of the convolutional neural network, but most of the current super-resolution methods do not attempt high-magnification image super-resolution reconstruction; only reconstruction with x 2, x 3, x 4 magnification is carried out for low-magnification down-sampled images without serious degradation. Based on this, this paper proposed a single-image high-magnification super-resolution method, which extends the scale factor of image super-resolution to high magnification. By introducing the idea of multi-task learning, the process of the high-magnification image super-resolution process is decomposed into different super-resolution tasks. Different tasks are trained with different data, and network models for different tasks can be obtained. Through the cascade reconstruction of different task network models, a low-resolution image accumulates reconstruction advantages layer by layer, and we obtain the final high-magnification super-resolution reconstruction results. The proposed method shows better performance in quantitative and qualitative comparison on the benchmark dataset than other super-resolution methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Multi-Task Interaction Learning for Spatiospectral Image Super-Resolution
    Ma, Qing
    Jiang, Junjun
    Liu, Xianming
    Ma, Jiayi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2950 - 2961
  • [2] Real-World Image Super-Resolution as Multi-Task Learning
    Zhang, Wenlong
    Li, Xiaohui
    Shi, Guangyuan
    Chen, Xiangyu
    Zhang, Xiaoyun
    Qiao, Yu
    Wu, Xiao-Ming
    Dong, Chao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [3] Improvement of Text Image Super-Resolution Benefiting Multi-task Learning
    Honda, Kosuke
    Fujita, Hamido
    Kurematsu, Masaki
    ADVANCES AND TRENDS IN ARTIFICIAL INTELLIGENCE: THEORY AND PRACTICES IN ARTIFICIAL INTELLIGENCE, 2022, 13343 : 275 - 286
  • [4] MMSRNet: Pathological image super-resolution by multi-task and multi-scale learning
    Wu, Xinyue
    Chen, Zhineng
    Peng, Changgen
    Ye, Xiongjun
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 81
  • [5] Multi-Task Learning for Scene Text Image Super-Resolution with Multiple Transformers
    Honda, Kosuke
    Kurematsu, Masaki
    Fujita, Hamido
    Selamat, Ali
    ELECTRONICS, 2022, 11 (22)
  • [6] Multi-Category Image Super-Resolution with Convolutional Neural Network and Multi-Task Learning
    Urazoe, Kazuya
    Kuroki, Nobutaka
    Kato, Yu
    Ohtani, Shinya
    Hirose, Tetsuya
    Numa, Masahiro
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (01) : 183 - 193
  • [7] Variational multi-task MRI reconstruction: Joint reconstruction, registration and super-resolution
    Corona, Veronica
    Aviles-Rivero, Angelica
    Debroux, Noemie
    Le Guyader, Carole
    Schonlieb, Carola-Bibiane
    MEDICAL IMAGE ANALYSIS, 2021, 68
  • [8] Efficient image magnification and applications to super-resolution reconstruction
    Shao, Wenze
    Wei, Zhihui
    IEEE ICMA 2006: PROCEEDING OF THE 2006 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS 1-3, PROCEEDINGS, 2006, : 2372 - +
  • [9] Single Image Super-Resolution using Multi-Task Gaussian Process Regression
    Li, JianHong
    Wang, Dong
    Luo, Xiaonan
    2014 5TH INTERNATIONAL CONFERENCE ON DIGITAL HOME (ICDH), 2014, : 78 - 84
  • [10] High-magnification super-resolution FINCH microscopy using birefringent crystal lens interferometers
    Nisan Siegel
    Vladimir Lupashin
    Brian Storrie
    Gary Brooker
    Nature Photonics, 2016, 10 : 802 - 808