Human Bas-Relief Generation From a Single Photograph

被引:4
|
作者
Yang, Zhenjie [1 ]
Chen, Beijia [1 ]
Zheng, Youyi [2 ]
Chen, Xiang [2 ]
Zhou, Kun [2 ]
机构
[1] Zhejiang Univ, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, State Key Lab CAD & CG, Zijingang Campus, Hangzhou 310058, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Shape; Solid modeling; Estimation; Computational modeling; Image reconstruction; Image resolution; Human bas-relief; multi-person; occlusion resolution; contour matching; single image;
D O I
10.1109/TVCG.2021.3092877
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a semi-automatic method for producing human bas-relief from a single photograph. Given an input photo of one or multiple persons, our method first estimates a 3D skeleton for each person in the image. SMPL models are then fitted to the 3D skeletons to generate a 3D guide model. To align the 3D guide model with the image, we compute a 2D warping field to non-rigidly register the projected contours of the guide model with the body contours in the image. Then the normal map of the 3D guide model is warped by the 2D deformation field to reconstruct an overall base shape. Finally, the base shape is integrated with a fine-scale normal map to produce the final bas-relief. To tackle the complex intra- and inter-body interactions, we design an occlusion relationship resolution method that operates at the level of 3D skeletons with minimal user inputs. To tightly register the model contours to the image contours, we propose a non-rigid point matching algorithm harnessing user-specified sparse correspondences. Experiments demonstrate that our human bas-relief generation method is capable of producing perceptually realistic results on various single-person and multi-person images, on which the state-of-the-art depth and pose estimation methods often fail.
引用
收藏
页码:4558 / 4569
页数:12
相关论文
共 50 条
  • [1] Neural Modeling of Portrait Bas-Relief From a Single Photograph
    Zhang, Yu-Wei
    Luo, Ping
    Zhou, Hao
    Ji, Zhongping
    Liu, Hui
    Chen, Yanzhao
    Zhang, Caiming
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (12) : 5008 - 5019
  • [2] Bas-relief generation from face photograph based on facial feature enhancement
    Hai Thien To
    Bong-Soo Sohn
    Multimedia Tools and Applications, 2017, 76 : 10407 - 10423
  • [3] Bas-relief generation from face photograph based on facial feature enhancement
    Hai Thien To
    Sohn, Bong-Soo
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (08) : 10407 - 10423
  • [4] Region-based bas-relief generation from a single image
    Zeng, Qiong
    Martin, Ralph R.
    Wang, Lu
    Quinn, Jonathan A.
    Sun, Yuhong
    Tu, Changhe
    GRAPHICAL MODELS, 2014, 76 : 140 - 151
  • [5] Unsupervised bas-relief generation with angle defect
    Liu, Xiao
    Nie, Jianhui
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4911 - 4916
  • [6] Unsupervised bas-relief generation with feature transferring
    Liu, Xiao
    Nie, Jianhui
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (05) : 13181 - 13195
  • [7] Unsupervised bas-relief generation with feature transferring
    Xiao Liu
    Jianhui Nie
    Multimedia Tools and Applications, 2024, 83 : 13181 - 13195
  • [8] The bas-relief ambiguity
    Belhumeur, PN
    Kriegman, DJ
    Yuille, AL
    1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, : 1060 - 1066
  • [9] Bas-relief tableaux
    Meiners, Dennis
    CERAMICS-TECHNICAL, 2008, (26) : 17 - 20
  • [10] Feather in Bas-Relief
    Butt, Allen Edwin
    POETRY, 2009, 193 (04) : 315 - 315