High-Magnification Super-Resolution Reconstruction of Image with Multi-Task Learning

被引:3
|
作者
Li, Yanghui [1 ]
Zhu, Hong [1 ]
Yu, Shunyuan [2 ]
机构
[1] Xian Univ Technol, Fac Automat & Informat Engn, Xian 710048, Peoples R China
[2] Ankang Univ, Inst Elect & Informat Engn, Ankang 725000, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; high-magnification; single-image super-resolution; convolutional neural network; QUALITY ASSESSMENT; NETWORK;
D O I
10.3390/electronics11091412
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single-image super-resolution technology has made great progress with the development of the convolutional neural network, but most of the current super-resolution methods do not attempt high-magnification image super-resolution reconstruction; only reconstruction with x 2, x 3, x 4 magnification is carried out for low-magnification down-sampled images without serious degradation. Based on this, this paper proposed a single-image high-magnification super-resolution method, which extends the scale factor of image super-resolution to high magnification. By introducing the idea of multi-task learning, the process of the high-magnification image super-resolution process is decomposed into different super-resolution tasks. Different tasks are trained with different data, and network models for different tasks can be obtained. Through the cascade reconstruction of different task network models, a low-resolution image accumulates reconstruction advantages layer by layer, and we obtain the final high-magnification super-resolution reconstruction results. The proposed method shows better performance in quantitative and qualitative comparison on the benchmark dataset than other super-resolution methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Hyperspectral Image Super-Resolution with RGB Image Super-Resolution as an Auxiliary Task
    Li, Ke
    Dai, Dengxin
    van Gool, Luc
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 4039 - 4048
  • [22] Super-resolution image reconstruction
    Kang, MG
    Chaudhuri, S
    IEEE SIGNAL PROCESSING MAGAZINE, 2003, 20 (03) : 19 - 20
  • [23] FCSR-GAN: Joint Face Completion and Super-Resolution via Multi-Task Learning
    Cai J.
    Han H.
    Shan S.
    Chen X.
    IEEE Transactions on Biometrics, Behavior, and Identity Science, 2020, 2 (02): : 109 - 121
  • [24] Novel Multi-Task Learning for Motion Magnification
    Chen, Li
    Peng, Cong
    Zhao, Bingchao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (10) : 5973 - 5985
  • [25] Super-resolution for high magnification face images
    Yao, Yi
    Abidi, Besma
    Kalka, Nathan D.
    Schmid, Natalia
    Abidi, Mongi
    BIOMETRIC TECHNOLOGY FOR HUMAN IDENTIFICATION IV, 2007, 6539
  • [27] Learning-based Super-resolution Image Reconstruction on Multi-core Processor
    Goto, T.
    Kawamoto, Y.
    Sakuta, Y.
    Tsutsui, A.
    Sakurai, M.
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2012, 58 (03) : 941 - 946
  • [28] Multi-scale Super-resolution Reconstruction of a Single Image
    Liu, Jing
    Xue, Yuxin
    He, Shuai
    Zhang, Xiaoyan
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [29] A MULTI-TASK DEEP LEARNING FRAMEWORK COUPLING SEMANTIC SEGMENTATION AND IMAGE RECONSTRUCTION FOR VERY HIGH RESOLUTION IMAGERY
    Papadomanolaki, Maria
    Karantzalos, Konstantinos
    Vakalopoulou, Maria
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 1069 - 1072
  • [30] Super-Resolution Reconstruction of Cytoskeleton Image Based on Deep Learning
    Hu Fen
    Lin Yang
    Hou Mengdi
    Hu Haofeng
    Pan Leiting
    Liu Tiegen
    Xu Jingjun
    ACTA OPTICA SINICA, 2020, 40 (24)