Learning dynamic relationship between joints for 3D hand pose estimation from single depth map

被引:1
|
作者
Xing, Huiqin [1 ]
Yang, Jianyu [1 ]
Xiao, Yang [2 ]
机构
[1] Soochow Univ, Sch Rail Transportat, 8 Jixue Rd, Suzhou 215131, Jiangsu, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430000, Hubei, Peoples R China
关键词
Hand pose estimation; Dynamic anchor; Hand gesture; Depth map;
D O I
10.1016/j.jvcir.2023.103803
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D hand pose estimation from a single depth map is an essential topic in computer vision. Most existing methods are devoted to designing a model to capture more spatial information or designing loss functions based on prior knowledge to constrain the estimated pose with prior spatial information. In this work, we focus on constraining the estimation process with spatial information adaptively by learning the mutual position relationship between joint pairs. Specifically, we propose a dynamic relationship network (DRN) with dynamic anchors. The preset fixed anchors are employed to estimate the position of each joint initially. Then, each joint is considered a dynamic anchor, which plays the role of a dynamic regressor to adjust the initially estimated position of each joint. The final estimation of each joint is the weighted sum of the results from all the dynamic anchors. Extensive experiments on benchmarks demonstrate that our method provides competitive results compared with state-of-the-arts.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Hand Pose Estimation Based on Deep Learning Depth Map for Hand Gesture Recognition
    Otberdout, Naima
    Ballihi, Lahoucine
    Aboutajdine, Driss
    2017 INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV), 2017,
  • [22] Robust 3D Hand Pose Estimation From Single Depth Images Using Multi-View CNNs
    Ge, Liuhao
    Liang, Hui
    Yuan, Junsong
    Thalmann, Daniel
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (09) : 4422 - 4436
  • [23] Multi-virtual View Scoring Network for 3D Hand Pose Estimation from a Single Depth Image
    Tian, Yimeng
    Li, Chen
    Tian, Lihua
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2023, 2024, 1998 : 147 - 164
  • [24] Hierarchically constrained 3D hand pose estimation using regression forests from single frame depth data
    Kirac, Furkan
    Kara, Yunus Emre
    Akarun, Lale
    PATTERN RECOGNITION LETTERS, 2014, 50 : 91 - 100
  • [25] 3D Hand-Object Pose Estimation from Depth with Convolutional Neural Networks
    Goudie, Duncan
    Galata, Aphrodite
    2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 406 - 413
  • [26] The isometric self-organizing map for 3D hand pose estimation
    Guan, Haiying
    Feris, Rogerio S.
    Turk, Matthew
    PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION - PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE, 2006, : 263 - +
  • [27] Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation
    Yang, John
    Bhalgat, Yash
    Chang, Simyung
    Porikli, Fatih
    Kwak, Nojun
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2703 - 2713
  • [28] 3D Hand Pose Estimation with a Single Infrared Camera via Domain Transfer Learning
    Park, Gabyong
    Kim, Tae-Kyun
    Woo, Woontack
    2020 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2020), 2020, : 588 - 599
  • [29] 3D interacting hand pose and shape estimation from a single RGB image
    Gao, Chengying
    Yang, Yujia
    Li, Wensheng
    NEUROCOMPUTING, 2022, 474 : 25 - 36
  • [30] Real-time 3D Pose Estimation from Single Depth Images
    Schnuerer, Thomas
    Fuchs, Stefan
    Eisenbach, Markus
    Gross, Horst-Michael
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 716 - 724