Stereoscopic image super-resolution with interactive memory learning

被引:13
|
作者
Zhu, Xiangyuan [1 ]
Guo, Kehua [1 ]
Qiu, Tian [1 ]
Fang, Hui [2 ]
Wu, Zheng [1 ]
Tan, Xuyang [1 ]
Liu, Chao [3 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, South Rd Lushan, Changsha 410083, Hunan, Peoples R China
[2] Loughborough Univ, Comp Sci, Epinal Way, Loughborough LE11 3TU, Leics, England
[3] Acad Mil Sci, Inst Syst Engn, Peoples Liberat Army, Beijing 100000, Peoples R China
基金
美国国家科学基金会;
关键词
Image super-resolution; Stereo image; Interactive learning; Memory network; Feature refinement; PARALLAX ATTENTION; NETWORK;
D O I
10.1016/j.eswa.2023.120143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution aims to exploit the complementary information between image pairs and generate images with high resolution and rich details. However, existing methods explicitly calculate the similarity between image patches or pixels to build correspondence between different views. These hard -matching methods leave deep semantic information between image pairs unexplored. In this paper, a stereo image super-resolution method with interactive memory learning is designed to take advantage of the complementary information of different views in an implicit way. Specifically, we propose an interactive memory learning strategy to implicitly capture the semantic similarity between different views and design a feature dual-aggregation module for feature refinement. Extensive experiments on different datasets achieve state-of-the-art results, demonstrating that our method effectively boosts the quantitative and qualitative results of stereoscopic image pairs. Code can be found at: https://github.com/zhuxiangyuan1/IMLnet.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Learning stacking regressors for single image super-resolution
    Zhang, Kaibing
    Luo, Shuang
    Li, Minqi
    Jing, Junfeng
    Lu, Jian
    Xiong, Zenggang
    APPLIED INTELLIGENCE, 2020, 50 (12) : 4325 - 4341
  • [32] Learning-Based Nonparametric Image Super-Resolution
    Shyamsundar Rajaram
    Mithun Das Gupta
    Nemanja Petrovic
    Thomas S. Huang
    EURASIP Journal on Advances in Signal Processing, 2006
  • [33] Domain Transfer Learning for Hyperspectral Image Super-Resolution
    Li, Xiaoyan
    Zhang, Lefei
    You, Jane
    REMOTE SENSING, 2019, 11 (06)
  • [34] CONVEX DICTIONARY LEARNING FOR SINGLE IMAGE SUPER-RESOLUTION
    Ding, Pak Lun Kevin
    Li, Baoxin
    Chang, Kan
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 4058 - 4062
  • [35] COUPLED DICTIONARY LEARNING FOR MULTIMODAL IMAGE SUPER-RESOLUTION
    Song, Pingfan
    Mota, Joao F. C.
    Deligiannis, Nikos
    Rodrigues, Miguel R. D.
    2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 162 - 166
  • [36] Image Super-Resolution Based on MCA and Dictionary Learning
    Zhang, Kun
    Yin, Hongpeng
    Chai, Yi
    PROCEEDINGS OF THE 2015 CHINESE INTELLIGENT SYSTEMS CONFERENCE, VOL 2, 2016, 360 : 75 - 84
  • [37] Learning-based nonparametric image super-resolution
    Rajaram, Shyamsundar
    Das Gupta, Mithun
    Petrovic, Nemanja
    Huang, Thomas S.
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2006, 2006 (1) : 1 - 11
  • [38] Learning stacking regressors for single image super-resolution
    Kaibing Zhang
    Shuang Luo
    Minqi Li
    Junfeng Jing
    Jian Lu
    Zenggang Xiong
    Applied Intelligence, 2020, 50 : 4325 - 4341
  • [39] Augmented Coupled Dictionary Learning for Image Super-Resolution
    Rushdi, Muhammad
    Ho, Jeffrey
    2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 1, 2012, : 262 - 267
  • [40] Deep Learning for Image/Video Restoration and Super-resolution
    Tekalp, A. Murat
    FOUNDATIONS AND TRENDS IN COMPUTER GRAPHICS AND VISION, 2022, 13 (01): : 1 - 110