Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks

被引：480

作者：

Tompson, Jonathan ^{[1
]}

Stein, Murphy ^{[1
]}

Lecun, Yann ^{[1
]}

Perlin, Ken ^{[1
]}

机构：

[1] NYU, New York, NY 10012 USA

来源：

ACM TRANSACTIONS ON GRAPHICS | 2014年 / 33卷 / 05期

关键词：

Hand tracking; neural networks; markerless motion capture; analysis-by-synthesis;

D O I：

10.1145/2629500

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

We present a novel method for real-time continuous pose recovery of markerless complex articulable objects from a single depth image. Our method consists of the following stages: a randomized decision forest classifier for image segmentation, a robust method for labeled dataset generation, a convolutional network for dense feature extraction, and finally an inverse kinematics stage for stable real-time pose recovery. As one possible application of this pipeline, we show state-of-the-art results for real-time puppeteering of a skinned hand-model.

引用

页数：10

共 50 条

[31] Real Time 3D Pose Estimation of Both Human Hands via RGB-Depth Camera and Deep Convolutional Neural Networks
Gi, Geon
Kim, Tae Yeon
Park, Hye Min
Park, Jeong Min
Dinh, Dong-Luong
Lee, Soo Yeol
Kim, Tae-Seong
7TH INTERNATIONAL CONFERENCE ON THE DEVELOPMENT OF BIOMEDICAL ENGINEERING IN VIETNAM (BME7): TRANSLATIONAL HEALTH SCIENCE AND TECHNOLOGY FOR DEVELOPING COUNTRIES, 2020, 69 : 467 - 471
[32] Real-Time Hair Filtering with Convolutional Neural Networks
Currius, Roc R.
Assarsson, Ulf
Sintorn, Erik
PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2022, 5 (01)
[33] Real-time Detection of Aortic Valve in Echocardiography using Convolutional Neural Networks
Nizar, Muhammad Hanif Ahmad
Chan, Chow Khuen
Khalil, Azira
Yusof, Ahmad Khairuddin Mohamed
Lai, Khin Wee
CURRENT MEDICAL IMAGING, 2020, 16 (05) : 584 - 591
[34] Real-Time Driver Distraction Detection System Using Convolutional Neural Networks
Kapoor, Khyati
Pamula, Rajendra
Murthy, Sristi Vns
PROCEEDINGS OF ICETIT 2019: EMERGING TRENDS IN INFORMATION TECHNOLOGY, 2020, 605 : 280 - 291
[35] Real-time Hand Gesture Detection and Classification Using Convolutional Neural Networks
Koepueklue, Okan
Gunduz, Ahmet
Kose, Neslihan
Rigoll, Gerhard
2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 407 - 414
[36] Real-Time Detection of Face Mask Usage Using Convolutional Neural Networks
Kanavos, Athanasios
Papadimitriou, Orestis
Al-Hussaeni, Khalil
Maragoudakis, Manolis
Karamitsos, Ioannis
COMPUTERS, 2024, 13 (07)
[37] Real-Time Plant Health Detection Using Deep Convolutional Neural Networks
Khalid, Mahnoor
Sarfraz, Muhammad Shahzad
Iqbal, Uzair
Aftab, Muhammad Umar
Niedbala, Gniewko
Rauf, Hafiz Tayyab
AGRICULTURE-BASEL, 2023, 13 (02):
[38] Evaluating Real-Time Strategy Game States Using Convolutional Neural Networks
Stanescu, Marius
Barriga, Nicolas A.
Hess, Andy
Buro, Michael
2016 IEEE CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND GAMES (CIG), 2016,
[39] Real-time Traffic Sign Classification Using Combined Convolutional Neural Networks
Chen, Lingying
Zhao, Guanghui
Zhou, Junwei
Kuang, Li
PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 399 - 404
[40] Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks
Ge, Liuhao
Liang, Hui
Yuan, Junsong
Thalmann, Daniel
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (04) : 956 - 970

← 1 2 3 4 5 →