Visual comfort enhancement in stereoscopic 3D images using saliency-adaptive nonlinear disparity mapping

被引:15
|
作者
Jung, Cheolkon [1 ]
Cao, Lihui [1 ]
Liu, Hongmin [1 ]
Kim, Joongkyu [2 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Sungkyunkwan Univ, Coll Informat & Commun Engn, Suwon 440746, South Korea
基金
中国国家自然科学基金;
关键词
Stereoscopic 3D (S3D) displays; Visual comfort enhancement; Saliency-adaptive; Salient region; Nonlinear disparity mapping; Depth-image-based-rendering (DIBR); DISCOMFORT; MODEL;
D O I
10.1016/j.displa.2015.05.006
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Perceptually salient regions have a significant effect on visual comfort in stereoscopic 3D (S3D) images. The conventional method of obtaining saliency maps is linear combination, which often weakens the saliency influence and distorts the original disparity range significantly. In this paper, we propose visual comfort enhancement in S3D images using saliency-adaptive nonlinear disparity mapping. First, we obtain saliency-adaptive disparity maps with visual sensitivity to maintain the disparity-based saliency influence. Then, we perform nonlinear disparity mapping based on a sigmoid function to minimize disparity distortions. Finally, we generate visually comfortable S3D images based on depth-image-based-rendering (DIBR). Experimental results demonstrate that the proposed method successfully improves visual comfort in S3D images by producing comfortable S3D images with high mean opinion score (MOS) while keeping the overall viewing image quality. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:17 / 23
页数:7
相关论文
共 50 条
  • [11] Impact of Negative Disparity for Spatial Anti-aliased Stereoscopic 3D Image on Visual Comfort
    Bu, Qi
    Yang, Yu
    Hai, Xueping
    2018 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION ENGINEERING TECHNOLOGY (CCET), 2018, : 296 - 299
  • [12] VISUAL COMFORT ASSESSMENT OF STEREOSCOPIC IMAGES USING DEEP VISUAL AND DISPARITY FEATURES BASED ON HUMAN ATTENTION
    Jeong, Hyunwook
    Kim, Hak Gu
    Ro, Yong Man
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 715 - 719
  • [13] Visual Comfort Improvement in Stereoscopic 3D Displays Using Perceptually Plausible Assessment Metric of Visual Comfort
    Jung, Yong Ju
    Sohn, Hosik
    Lee, Seong-il
    Ro, Yong Man
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2014, 60 (01) : 1 - 9
  • [14] Perceived depth quality - preserving visual comfort improvement method for stereoscopic 3D images
    Ying, Hongwei
    Yu, Mei
    Jiang, Gangyi
    Peng, Zongju
    Chen, Fen
    SIGNAL PROCESSING, 2020, 169
  • [15] Visual Comfort Aware-Reinforcement Learning for Depth Adjustment of Stereoscopic 3D Images
    Kim, Hak Gu
    Park, Minho
    Lee, Sangmin
    Kim, Seongyeop
    Ro, Yong Man
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1762 - 1770
  • [16] Saliency Detection for Stereoscopic 3D Images in the Quaternion Frequency Domain
    Cai, Xingyu
    Zhou, Wujie
    Cen, Gang
    Qiu, Weiwei
    3D RESEARCH, 2018, 9 (02):
  • [17] Visual enhancement of 3D images of rock faces for fracture mapping
    Lai, P.
    Samson, C.
    Bose, P.
    INTERNATIONAL JOURNAL OF ROCK MECHANICS AND MINING SCIENCES, 2014, 72 : 325 - 335
  • [18] Visual discomfort relaxation for stereoscopic 3D images by adjusting zero-disparity plane for projection
    Shao, Feng
    Li, Zhutuan
    Jiang, Qiuping
    Jiang, Gangyi
    Yu, Mei
    Peng, Zongju
    DISPLAYS, 2015, 39 : 125 - 132
  • [19] A Visual Disparity Adjustment Method for Stereoscopic 3D Animation Production
    Ma, Huadong (mhd@bupt.edu.cn), 2017, Institute of Computing Technology (29):
  • [20] 3D visual saliency detection model with generated disparity map
    Feng Qi
    Debin Zhao
    Shaohui Liu
    Xiaopeng Fan
    Multimedia Tools and Applications, 2017, 76 : 3087 - 3103