Real-time 3D human pose recovery from a single depth image using principal direction analysis

被引:12
|
作者
Dong-Luong Dinh [1 ]
Lim, Myeong-Jun [2 ]
Nguyen Duc Thang [3 ]
Lee, Sungyoung [1 ]
Kim, Tae-Seong [2 ]
机构
[1] Kyung Hee Univ, Dept Comp Engn, Yongin, Gyeonggi Do, South Korea
[2] Kyung Hee Univ, Dept Biomed Engn, Yongin, Gyeonggi Do, South Korea
[3] Int Univ, Dept Biomed Engn, Ho Chi Minh City, Vietnam
基金
新加坡国家研究基金会;
关键词
3D human pose recovery; Depth image; Body part recognition; Principal direction analysis; HUMAN MOTION ANALYSIS; MEAN SHIFT;
D O I
10.1007/s10489-014-0535-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we present a novel approach to recover a 3D human pose in real-time from a single depth image using principal direction analysis (PDA). Human body parts are first recognized from a human depth silhouette via trained random forests (RFs). PDA is applied to each recognized body part, which is presented as a set of points in 3D, to estimate its principal direction. Finally, a 3D human pose is recovered by mapping the principal direction to each body part of a 3D synthetic human model. We perform both quantitative and qualitative evaluations of our proposed 3D human pose recovering methodology. We show that our proposed approach has a low average reconstruction error of 7.07 degrees for four key joint angles and performs more reliably on a sequence of unconstrained poses than conventional methods. In addition, our methodology runs at a speed of 20 FPS on a standard PC, indicating that our system is suitable for real-time applications. Our 3D pose recovery methodology is applicable to applications ranging from human computer interactions to human activity recognition.
引用
收藏
页码:473 / 486
页数:14
相关论文
共 50 条
  • [1] Real-time 3D human pose recovery from a single depth image using principal direction analysis
    Dong-Luong Dinh
    Myeong-Jun Lim
    Nguyen Duc Thang
    Sungyoung Lee
    Tae-Seong Kim
    Applied Intelligence, 2014, 41 : 473 - 486
  • [2] Real-time 3D Pose Estimation from Single Depth Images
    Schnuerer, Thomas
    Fuchs, Stefan
    Eisenbach, Markus
    Gross, Horst-Michael
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 716 - 724
  • [3] REAL-TIME 3D RECONSTRUCTION AND POSE ESTIMATION FOR HUMAN MOTION ANALYSIS
    Graf, Holger
    Yoon, Sang Min
    Malerczyk, Cornelius
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 3981 - 3984
  • [4] VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera
    Mehta, Dushyant
    Sridhar, Srinath
    Sotnychenko, Oleksandr
    Rhodin, Helge
    Shafiei, Mohammad
    Seidel, Hans-Peter
    Xu, Weipeng
    Casas, Dan
    Theobalt, Christian
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [5] Accurate 3D Pose Estimation From a Single Depth Image
    Ye, Mao
    Wang, Xianwang
    Yang, Ruigang
    Ren, Liu
    Pollefeys, Marc
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 731 - 738
  • [6] Real-Time Human Pose Recognition in Parts from Single Depth Images
    Shotton, Jamie
    Fitzgibbon, Andrew
    Cook, Mat
    Sharp, Toby
    Finocchio, Mark
    Moore, Richard
    Kipman, Alex
    Blake, Andrew
    2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, : 1297 - 1304
  • [7] Real-Time Human Pose Recognition in Parts from Single Depth Images
    Shotton, Jamie
    Sharp, Toby
    Kipman, Alex
    Fitzgibbon, Andrew
    Finocchio, Mark
    Blake, Andrew
    Cook, Mat
    Moore, Richard
    COMMUNICATIONS OF THE ACM, 2013, 56 (01) : 116 - 124
  • [8] 3D human pose and shape estimation with dense correspondence from a single depth image
    Wang, Kangkan
    Zhang, Guofeng
    Yang, Jian
    VISUAL COMPUTER, 2023, 39 (01): : 429 - 441
  • [9] 3D human pose and shape estimation with dense correspondence from a single depth image
    Kangkan Wang
    Guofeng Zhang
    Jian Yang
    The Visual Computer, 2023, 39 : 429 - 441
  • [10] Real-Time 3D Pose and Correspondence from Stereo Image Sequences by Combinatorial Optimization
    Raytchev, Bisser
    Kimura, Yusuke
    2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,