3D Motion and Skeleton Construction from Monocular Video

被引：0

作者：

Azmi, Nik Mohammad Wafiy ^{[1
]}

Albakri, Ikmal Faiq ^{[1
]}

Suaib, Norhaida Mohd ^{[1
]}

Rahim, Mohd Shafry Mohd ^{[1
]}

Yu, Hongchuan ^{[2
]}

机构：

[1] Univ Teknol Malaysia, Fac Engn, Sch Comp, Johor Baharu, Malaysia

[2] Bournemouth Univ, Natl Ctr Comp Animat, Poole, Dorset, England

来源：

COMPUTATIONAL SCIENCE AND TECHNOLOGY (ICCST 2019) | 2020年 / 603卷

基金：

欧盟地平线“2020”;

关键词：

Convolutional Neural Network; Human Mesh Recovery; 2D annotation; 3D annotation; Maya; Maya Standalone; HIK; Part-affinity;

D O I：

10.1007/978-981-15-0058-9_8

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We describe 3D motion construction as a framework for constructing a 3D motion and skeleton using a monocular video source (2D video). The processes include 3 main phases which involved in generating ground truth 2D annotation using OpenPose, generating the mesh and 3D matrices of person in the sequences of images based on 2D annotation and bounding box and lastly using the matrices to create a HIK 3D skeleton in a standalone Maya application. For the process, we highly relied on the 2D annotation using Convolution Neural Network. We demonstrate our result using a video of Malaysia Traditional Dance called zapin.

引用

页码：75 / 84

页数：10

共 50 条

[41] Temporal Feature Fusion for 3D Detection in Monocular Video
Cheng, Haoran
Peng, Liang
Yang, Zheng
Lin, Binbin
He, Xiaofei
Wu, Boxi
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 2665 - 2675
[42] Unsupervised skeleton extraction and motion capture from 3D deformable matching
Zhang, Quanshi
Song, Xuan
Shao, Xiaowei
Shibasaki, Ryosuke
Zhao, Huijing
NEUROCOMPUTING, 2013, 100 : 170 - 182
[43] Retrieval of spatial–temporal motion topics from 3D skeleton data
Qianhui Men
Howard Leung
The Visual Computer, 2019, 35 : 973 - 984
[44] Monocular 3D Object Detection With Motion Feature Distillation
Hu, Henan
Li, Muyu
Zhu, Ming
Gao, Wen
Liu, Peiyu
Chan, Kwok-Leung
IEEE ACCESS, 2023, 11 : 82933 - 82945
[45] 3D Human Motion Reconstruction in Unity with Monocular Camera
Chen, Tai-Wei
Lin, Wei-Liang
2020 17TH INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC 2020), 2020, : 191 - 192
[46] Uncertainty-Aware 3D Human Pose Estimation from Monocular Video
Zhang, Jinlu
Chen, Yujin
Tu, Zhigang
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 5102 - 5113
[47] NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video
Sun, Jiaming
Xie, Yiming
Chen, Linghao
Zhou, Xiaowei
Bao, Hujun
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15593 - 15602
[48] Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video
Zhou, Xiaowei
Zhu, Menglong
Leonardos, Spyridon
Derpanis, Konstantinos G.
Daniilidis, Kostas
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4966 - 4975
[49] Monocular lie algebra approach for 3D motion estimation
Ortegon-Aguilar, J
Bayro-Corrochano, E
PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, 2004, : 200 - 203
[50] Whole Stomach 3D Reconstruction and Frame Localization From Monocular Endoscope Video
Widya, Aji Resindra
Monno, Yusuke
Okutomi, Masatoshi
Suzuki, Sho
Gotoda, Takuji
Miki, Kenji
IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2019, 7

← 1 2 3 4 5 →