3D human body reconstruction based on SMPL model

被引:0
|
作者
Dongyue Chen
Yuanyuan Song
Fangzheng Liang
Teng Ma
Xiaoming Zhu
Tong Jia
机构
[1] Northeastern University,Artificial Intelligence Laboratory
来源
The Visual Computer | 2023年 / 39卷
关键词
3D human reconstruction; SMPL; Pose estimation;
D O I
暂无
中图分类号
学科分类号
摘要
Recovering 3D human pose and body shape from a monocular image is a challenging task in computer vision. In this paper, we present an optimization-based algorithm and an innovative framework to reconstruct 3D human body from a single monocular image. All the evaluation tasks are established on the basis of the classic parametric 3D body model SMPL. Firstly, a new combined objective function of SMPL parameters is proposed to involve four loss terms on 2D joints, 3D joints, facial landmarks and pose priori, respectively, which increase the reliability of the evaluation results dramatically. Furthermore, we use the estimation results given by an end-to-end regression network as the initial values of the parameters, which has been proved to speed up the optimization process. The experiments on benchmark datasets Human 3.6 M, LSP and a wild dataset demonstrate that our model achieves an accurate and robust estimation of the 3D human body and outperforms the popular competing algorithms in precision and robustness.
引用
收藏
页码:1893 / 1906
页数:13
相关论文
共 50 条
  • [21] Fast 3D human body reconstruction from kinects
    Pan, J. (mathpan@hdu.edu.cn), 1600, Institute of Computing Technology (25):
  • [22] 3D reconstruction of a human body from multiple viewpoints
    Yamauchi, Koichiro
    Kameshima, Hideto
    Saito, Hideo
    Sato, Yukio
    ADVANCES IN IMAGE AND VIDEO TECHNOLOGY, PROCEEDINGS, 2007, 4872 : 439 - 448
  • [23] Reconstruction of 3D human body pose for gait recognition
    Yang, HD
    Lee, SW
    ADVANCES IN BIOMETRICS, PROCEEDINGS, 2006, 3832 : 619 - 625
  • [24] 3D shape measurement techniques for human body reconstruction
    Xhimitiku, Iva
    Pascoletti, Giulia
    Zanetti, Elisabetta M.
    Rossi, Gianluca
    ACTA IMEKO, 2022, 11 (02): : 1 - 8
  • [25] Reconstruction of 3D human body pose based on top-down learning
    Yang, HD
    Park, SK
    Lee, SW
    ADVANCES IN INTELLIGENT COMPUTING, PT 1, PROCEEDINGS, 2005, 3644 : 601 - 610
  • [26] Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstruction
    Zhang, Yufei
    Wang, Hanjing
    Kephart, Jeffrey O.
    Ji, Qiang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 8986 - 8998
  • [27] Study on 3D reconstruction techniques of rocket body model based on strain monitor
    Chen, Aihua
    Cao, Long
    Yan, Guowei
    Xu, Ze
    2020 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE COMMUNICATION AND NETWORK SECURITY (CSCNS2020), 2021, 336
  • [28] Reconstruction and Body Size Detection of 3D Sheep Body Model Based on Point Cloud Data
    Zhou, Yanqing
    Xue, Heru
    Wang, Chunlan
    Jiang, Xinhua
    Gao, Xiaojing
    Bai, Jie
    COMPUTER AND COMPUTING TECHNOLOGIES IN AGRICULTURE XI, CCTA 2017, PT II, 2019, 546 : 251 - 262
  • [29] Study on 3D Model Reconstruction of Human Knee Joint Based on MRI
    Han, Yuemei
    MEASUREMENT TECHNOLOGY AND ENGINEERING RESEARCHES IN INDUSTRY, PTS 1-3, 2013, 333-335 : 934 - 937
  • [30] 3D HUMAN SHPAE RECONSTRUCTION FROM PHOTOGRAPHS BASED TEMPLATE MODEL
    Zhang, Dian-yong
    Miao, Zhen-jiang
    ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 1466 - 1469