Manifolds for pose tracking from monocular video

被引:4
|
作者
Basu, Saurav [1 ,2 ]
Poulin, Joshua [3 ]
Acton, Scott T. [1 ]
机构
[1] Univ Virginia, Charles L Brown Dept Elect & Comp Engn, Charlottesville, VA 22904 USA
[2] IBM Res, New Delhi 110070, India
[3] Hanscom AFB, Laurence G Hanscom Field, Bedford, MA 01731 USA
关键词
pose tracking; video analysis; manifolds; motion vector flow; PEOPLE;
D O I
10.1117/1.JEI.24.2.023014
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We formulate a simple human-pose tracking theory from monocular video based on the fundamental relationship between changes in pose and image motion vectors. We investigate the natural embedding of the low-dimensional body pose space into a high-dimensional space of body configurations that behaves locally in a linear manner. The embedded manifold facilitates the decomposition of the image motion vectors into basis motion vector fields of the tangent space to the manifold. This approach benefits from the style invariance of image motion flow vectors, and experiments to validate the fundamental theory show reasonable accuracy (within 4.9 deg of the ground truth). (C) 2015 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Padel Two-Dimensional Tracking Extraction from Monocular Video Recordings
    Novillo, Alvaro
    Acena, Victor
    Lancho, Carmen
    Cuesta, Marina
    De Diego, Isaac Martin
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2024, PT I, 2025, 15346 : 110 - 120
  • [32] Tracking monocular camera pose and deformation for SLAM inside the human body
    Gomez Rodriguez, Juan J.
    Montiel, J. M. M.
    Tardos, Juan D.
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 5278 - 5285
  • [33] Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview
    Fan, Zhaoxin
    Zhu, Yazhi
    He, Yulin
    Sun, Qi
    Liu, Hongyan
    He, Jun
    ACM COMPUTING SURVEYS, 2023, 55 (04)
  • [34] Human Pose Tracking in Monocular Sequence Using Multilevel Structured Models
    Lee, Mun Wai
    Nevatia, Ramakant
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (01) : 27 - 38
  • [35] The Monocular Model-based 3D Pose Tracking
    Tong, Guofeng
    Liu, Ran
    Li, Hairong
    PROCEEDINGS OF THE 2012 24TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2012, : 980 - 985
  • [36] Real-Time Monocular Segmentation and Pose Tracking of Multiple Objects
    Tjaden, Henning
    Schwanecke, Ulrich
    Schoemer, Elmar
    COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 : 423 - 438
  • [37] Pose Tracking of Moving Sensor using Monocular Camera and IMU Sensor
    Jung, Sukwoo
    Park, Seho
    Lee, KyungTaek
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (08) : 3011 - 3024
  • [38] 3D Hierarchical Refinement and Augmentation for Unsupervised Learning of Depth and Pose From Monocular Video
    Wang, Guangming
    Zhong, Jiquan
    Zhao, Shijie
    Wu, Wenhua
    Liu, Zhe
    Wang, Hesheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1776 - 1786
  • [39] Stereoscopic video synthesis from a monocular video
    Zhang, Guofeng
    Hua, Wei
    Qin, Xueying
    Wong, Tien-Tsin
    Bao, Hujun
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2007, 13 (04) : 686 - 696
  • [40] Estimation of 3-D pose and shape from a monocular image sequence and realtime human tracking
    Shirai, Y
    INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN 3-D DIGITAL IMAGING AND MODELING, PROCEEDINGS, 1997, : 130 - 139