Reconstruct 3D human motion using motion library

被引:0
|
作者
Qiu, Xianjie [1 ]
Wang, Wenzhong [1 ,2 ]
Wang, Rongrong [1 ]
Li, Jintao [1 ]
Wang, Zhaoqi [1 ]
机构
[1] Chinese Acad Sci, Bur Hightech Res & Dev, 52 Sanlihe Rd, Beijing 100864, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing 100864, Peoples R China
基金
北京市自然科学基金; 美国国家科学基金会;
关键词
motion capture; human motion reconstruction; motion library;
D O I
暂无
中图分类号
K9 [地理];
学科分类号
0705 ;
摘要
In this paper, we present a new approach to reconstruct 3D human motion from video clips with the assistance of a precaptured motion library. Given a monocular video clip recording of one person performing some kind of locomotion and a motion library consisting of similar motions, we can infer the 3D motion from the video clip. The approach segment the video clip into segments with fixed length, and by using a shape matching method we can find out from the motion library several candidate motion sequences for each video segment, then from these sequences a coarse motion clip is generated by performing a continuity test on the boundaries of these candidate sequences. We propose a pose deformation algorithm to refine the coarse motion. To guarantee the nature of the recovered motion, we apply a motion splicing algorithm to the motion clip. The experimental results show the effectiveness of this approach.
引用
收藏
页码:173 / +
页数:4
相关论文
共 50 条
  • [1] Reconstruct 3D human motion from monocular video using motion library
    Wang, Wenzhong
    Qiu, Xianjie
    Wang, Zhaoqi
    Wang, Rongrong
    Li, Jintao
    ADVANCES IN MULTIMEDIA MODELING, PROCEEDINGS, 2008, 4903 : 242 - 252
  • [2] Learning to Reconstruct 3D Structure from Object Motion
    Liu, Wentao
    Dou, Haobin
    Wu, Xihong
    NEURAL INFORMATION PROCESSING, PT I, 2015, 9489 : 127 - 137
  • [3] Motion Improvisation: 3D Human Motion Synthesis with a Transformer
    Liu, Yimeng
    Sra, Misha
    ADJUNCT PROCEEDINGS OF THE 34TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, UIST 2021, 2021, : 26 - 28
  • [4] 3D human motion reconstruction using video processing
    Roodsarabi, Nadiya
    Behrad, Alireza
    IMAGE AND SIGNAL PROCESSING, 2008, 5099 : 386 - 395
  • [5] 3d human motion tracking using manifold learning
    Guo, Feng
    Qian, Gang
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 357 - +
  • [6] TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis
    Petrovich, Mathis
    Black, Michael J.
    Varol, Guel
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 9454 - 9463
  • [7] Online motion recognition for 3D human motion with rejection determination
    Cai, Meiling
    Zou, Beiji
    ICIC Express Letters, 2012, 6 (11): : 2739 - 2744
  • [8] 3D human motion prediction: A survey
    Lyu, Kedi
    Chen, Haipeng
    Liu, Zhenguang
    Zhang, Beiqi
    Wang, Ruili
    NEUROCOMPUTING, 2022, 489 (345-365) : 345 - 365
  • [9] MODELING AND TRANSFORMATION OF 3D HUMAN MOTION
    Etemad, Seyed Ali
    Arya, Ali
    GRAPP 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS THEORY AND APPLICATIONS, 2010, : 307 - 315
  • [10] Advances in description of 3D human motion
    Khokhlova, Margarita
    Migniot, Cyrille
    Dipanda, Albert
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (24) : 31665 - 31691