3D Motion and Skeleton Construction from Monocular Video

被引:0
|
作者
Azmi, Nik Mohammad Wafiy [1 ]
Albakri, Ikmal Faiq [1 ]
Suaib, Norhaida Mohd [1 ]
Rahim, Mohd Shafry Mohd [1 ]
Yu, Hongchuan [2 ]
机构
[1] Univ Teknol Malaysia, Fac Engn, Sch Comp, Johor Baharu, Malaysia
[2] Bournemouth Univ, Natl Ctr Comp Animat, Poole, Dorset, England
基金
欧盟地平线“2020”;
关键词
Convolutional Neural Network; Human Mesh Recovery; 2D annotation; 3D annotation; Maya; Maya Standalone; HIK; Part-affinity;
D O I
10.1007/978-981-15-0058-9_8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We describe 3D motion construction as a framework for constructing a 3D motion and skeleton using a monocular video source (2D video). The processes include 3 main phases which involved in generating ground truth 2D annotation using OpenPose, generating the mesh and 3D matrices of person in the sequences of images based on 2D annotation and bounding box and lastly using the matrices to create a HIK 3D skeleton in a standalone Maya application. For the process, we highly relied on the 2D annotation using Convolution Neural Network. We demonstrate our result using a video of Malaysia Traditional Dance called zapin.
引用
收藏
页码:75 / 84
页数:10
相关论文
共 50 条
  • [1] 3D Reconstruction of Human Motion and Skeleton from Uncalibrated Monocular Video
    Chen, Yen-Lin
    Chai, Jinxiang
    COMPUTER VISION - ACCV 2009, PT I, 2010, 5994 : 71 - 82
  • [2] MotioNet: 3D Human motion reconstruction from monocular video with skeleton consistency
    Shi, Mingyi
    Aberman, Kfir
    Aristidou, Andreas
    Komura, Taku
    Lischinski, Dani
    Cohen-Or, Daniel
    Chen, Baoquan
    ACM Transactions on Graphics, 2020, 40 (01):
  • [3] MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency
    Shi, Mingyi
    Aberman, Kfir
    Aristidou, Andreas
    Komura, Taku
    Lischinski, Dani
    Cohen-Or, Daniel
    Chen, Baoquan
    ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (01):
  • [4] Reconstruct 3D human motion from monocular video using motion library
    Wang, Wenzhong
    Qiu, Xianjie
    Wang, Zhaoqi
    Wang, Rongrong
    Li, Jintao
    ADVANCES IN MULTIMEDIA MODELING, PROCEEDINGS, 2008, 4903 : 242 - 252
  • [5] 3D reconstruction of human skeleton from single images or monocular video sequences
    Remondino, F
    Roditakis, A
    PATTERN RECOGNITION, PROCEEDINGS, 2003, 2781 : 100 - 107
  • [6] Towards robust 3D reconstruction of human motion from monocular video
    Chen, Cheng
    Zhuang, Yueting
    Xiao, Jun
    Advances in Artificial Reality and Tele-Existence, Proceedings, 2006, 4282 : 594 - 603
  • [7] 3D scene reconstruction from monocular spherical video with motion parallax
    Tanaka, Kenji
    2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY ADJUNCT (ISMAR-ADJUNCT 2022), 2022, : 191 - 197
  • [8] Efficient 3D recovery of human motion in monocular video
    Chen, Cheng
    Xiao, Jun
    Zhuang, Yueting
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2009, 21 (08): : 1118 - 1126
  • [9] Markerless 3D human motion tracking for monocular video sequences
    Zou, Beiji
    Chen, Shu
    Peng, Xiaoning
    Shi, Cao
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2008, 20 (08): : 1047 - 1055
  • [10] Bayesian 3D tracking from monocular video
    Brau, Ernesto
    Guan, Jinyan
    Simek, Kyle
    Del Pero, Luca
    Dawson, Colin Reimer
    Barnard, Kobus
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 3368 - 3375