Manifolds for pose tracking from monocular video

被引:4
|
作者
Basu, Saurav [1 ,2 ]
Poulin, Joshua [3 ]
Acton, Scott T. [1 ]
机构
[1] Univ Virginia, Charles L Brown Dept Elect & Comp Engn, Charlottesville, VA 22904 USA
[2] IBM Res, New Delhi 110070, India
[3] Hanscom AFB, Laurence G Hanscom Field, Bedford, MA 01731 USA
关键词
pose tracking; video analysis; manifolds; motion vector flow; PEOPLE;
D O I
10.1117/1.JEI.24.2.023014
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We formulate a simple human-pose tracking theory from monocular video based on the fundamental relationship between changes in pose and image motion vectors. We investigate the natural embedding of the low-dimensional body pose space into a high-dimensional space of body configurations that behaves locally in a linear manner. The embedded manifold facilitates the decomposition of the image motion vectors into basis motion vector fields of the tangent space to the manifold. This approach benefits from the style invariance of image motion flow vectors, and experiments to validate the fundamental theory show reasonable accuracy (within 4.9 deg of the ground truth). (C) 2015 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 50 条
  • [11] Bayesian 3D tracking from monocular video
    Brau, Ernesto
    Guan, Jinyan
    Simek, Kyle
    Del Pero, Luca
    Dawson, Colin Reimer
    Barnard, Kobus
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 3368 - 3375
  • [12] Movement tracking from monocular video based on the particle filter
    Lyu, Lei
    Ma, Naiqi
    Liu, Hong
    2017 IEEE THIRD INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2017), 2017, : 407 - 412
  • [13] 3D face pose tracking from an uncalibrated monocular camera
    Zhu, ZW
    Ji, Q
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, 2004, : 400 - 403
  • [14] 3D Face pose estimation and tracking from a monocular camera
    Ji, Q
    IMAGE AND VISION COMPUTING, 2002, 20 (07) : 499 - 511
  • [15] Robust monocular object pose tracking for large pose shift using 2D tracking
    Qiufu Wang
    Jiexin Zhou
    Zhang Li
    Xiaoliang Sun
    Qifeng Yu
    Visual Intelligence, 1 (1):
  • [16] Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Video
    Chen, Xingyu
    Wang, Baoyuan
    Shum, Heung-Yeung
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8683 - 8693
  • [17] Animatable Human Rendering from Monocular Video via Pose-Independent Deformation
    Duan, Tong
    Jiang, Zekai
    Ma, Zipei
    Zhang, Dongyu
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI, 2025, 15036 : 241 - 254
  • [18] Automatic human body tracking and modeling from monocular video sequences
    Yu, Chih-Chang
    Hwang, Jenq-Neng
    Ho, Gang-Feng
    Hsieh, Chaur-Heh
    2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL I, PTS 1-3, PROCEEDINGS, 2007, : 917 - +
  • [19] Silhouette lookup for monocular 3D pose tracking
    Howe, Nicholas R.
    IMAGE AND VISION COMPUTING, 2007, 25 (03) : 331 - 341
  • [20] Rapid Tracking for Autonomous Driving with Monocular Video
    Wang, Patrick
    Torrione, Peter
    Collins, Leslie
    Morton, Kenneth
    2013 INTERNATIONAL CONFERENCE ON CONNECTED VEHICLES AND EXPO (ICCVE), 2013, : 133 - 138