Stereoscopic Image Generation From Light Field With Disparity Scaling and Super-Resolution

被引:5
|
作者
Yan, Tao [1 ]
Jiao, Jianbo [2 ,3 ]
Liu, Wenxi [4 ]
Lau, Rynson W. H. [5 ]
机构
[1] Jiangnan Univ, Jiangsu Key Lab Media Design & Software Technol, Wuxi 214122, Jiangsu, Peoples R China
[2] Univ Oxford, VGG, Oxford OX1 3QR, England
[3] Univ Oxford, BioMedIA Labs, Oxford OX1 3QR, England
[4] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Fujian, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereo image processing; Spatial resolution; Image synthesis; Three-dimensional displays; Cameras; Light field image processing; stereoscopic image synthesis; disparity scaling; super-resolution; VIDEO SYNTHESIS;
D O I
10.1109/TIP.2019.2944519
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel method to generate stereoscopic images from light-field images with the intended depth range and simultaneously perform image super-resolution. Subject to the small baseline of neighboring subaperture views and low spatial resolution of light-field images captured using compact commercial light-field cameras, the disparity range of any two subaperture views is usually very small. We propose a method to control the disparity range of the target stereoscopic images with linear or nonlinear disparity scaling and properly resolve the disocclusion problem with the aid of a smooth energy term previously used for texture synthesis. The left and right views of the target stereoscopic image are simultaneously generated by a unified optimization framework, which preserves content coherence between the left and right views by a coherence energy term. The disparity range of the target stereoscopic image can be larger than that of the input light field image. This benefits many light field image-based applications, e.g., displaying light field images on various stereo display devices and generating stereoscopic panoramic images from a light field image montage. An extensive experimental evaluation demonstrates the effectiveness of our method.
引用
收藏
页码:1827 / 1842
页数:16
相关论文
共 50 条
  • [1] Light Field Image Super-Resolution With Transformers
    Liang, Zhengyu
    Wang, Yingqian
    Wang, Longguang
    Yang, Jungang
    Zhou, Shilin
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 563 - 567
  • [2] Reivew of Light Field Image Super-Resolution
    Yu, Li
    Ma, Yunpeng
    Hong, Song
    Chen, Ke
    ELECTRONICS, 2022, 11 (12)
  • [3] Variational Light Field Analysis for Disparity Estimation and Super-Resolution
    Wanner, Sven
    Goldluecke, Bastian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (03) : 606 - 619
  • [4] Disparity-Guided Light Field Image Super-Resolution via Feature Modulation and Recalibration
    Liu, Gaosheng
    Yue, Huanjing
    Li, Kun
    Yang, Jingyu
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (03) : 740 - 752
  • [5] Disparity Enhancement-Based Light Field Angular Super-Resolution
    Cai, Dongjun
    Chen, Yilei
    Huang, Xinpeng
    An, Ping
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 81 - 85
  • [6] Residual Networks for Light Field Image Super-Resolution
    Zhang, Shuo
    Lin, Youfang
    Sheng, Hao
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11038 - 11047
  • [7] Recurrent Interaction Network for Stereoscopic Image Super-Resolution
    Zhang, Zhe
    Peng, Bo
    Lei, Jianjun
    Shen, Haifeng
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2048 - 2060
  • [8] Stereoscopic image super-resolution with interactive memory learning
    Zhu, Xiangyuan
    Guo, Kehua
    Qiu, Tian
    Fang, Hui
    Wu, Zheng
    Tan, Xuyang
    Liu, Chao
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 227
  • [9] Stereoscopic Image Super-Resolution with Stereo Consistent Feature
    Song, Wonil
    Choi, Sungil
    Jeong, Somi
    Sohn, Kwanghoon
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12031 - 12038
  • [10] Joint Light Field Spatial and Angular Super-Resolution From a Single Image
    Ivan, Andre
    Williem
    Park, In Kyu
    IEEE ACCESS, 2020, 8 : 112562 - 112573