Hierarchical topology based hand pose estimation from a single depth image

被引:3
|
作者
Ji, Yanli [1 ]
Li, Haoxin [1 ]
Yang, Yang [2 ]
Li, Shuying [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Automat Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Sichuan, Peoples R China
[3] China Aerosp Sci & Technol Corp, Inst 16, Xian, Shaanxi, Peoples R China
关键词
Hand pose estimation; Regression forest; Hierarchical topology; Pose refinement;
D O I
10.1007/s11042-017-4651-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hand pose estimation benefits large human computer interaction applications. The hand pose has high dimensions of freedom (dof) for joints, and various hand poses are flexible. Hand pose estimation is still a challenge problem. Since hand joints on the hand skeleton topology model have strict relationships between each other, we propose a hierarchical topology based approach to estimate 3D hand poses. First, we determine palm positions and palm orientations by detecting hand fingertips and calculating their directions in depth images. It is the global topology of hand poses. Moreover, we define connection relationships of finger joints as the local topology of hand model. Based on hierarchical topology, we extract angle features to describe hand poses, and adopt the regression forest algorithm to estimate 3D coordinates of hand joints. We further use freedom forrest algorithm to refine ambiguous poses in estimation to solve error accumulation problem. The hierarchical topology based approach ensures estimated hand poses in a reasonable topology, and improves estimation accuracy. We evaluate our approach on two public databases, and experiments illustrate its efficiency. Compared with state-of-the-art approaches, our approach improves estimation accuracy.
引用
收藏
页码:10553 / 10568
页数:16
相关论文
共 50 条
  • [31] Hand Pose Estimation Based on Deep Learning Depth Map for Hand Gesture Recognition
    Otberdout, Naima
    Ballihi, Lahoucine
    Aboutajdine, Driss
    2017 INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV), 2017,
  • [32] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges
    Supancic, James Steven, III
    Rogez, Gregory
    Yang, Yi
    Shotton, Jamie
    Ramanan, Deva
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (11) : 1180 - 1198
  • [33] Depth-based hand pose estimation: data, methods, and challenges
    Supancic, James Steven, III
    Rogez, Gregory
    Yang, Yi
    Shotton, Jamie
    Ramanan, Deva
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1868 - 1876
  • [34] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges
    James Steven Supančič
    Grégory Rogez
    Yi Yang
    Jamie Shotton
    Deva Ramanan
    International Journal of Computer Vision, 2018, 126 : 1180 - 1198
  • [35] 3D Hand Pose Estimation from Single Depth Images with Label Distribution Learning
    Xu, Yuanfei
    Wang, Xupeng
    2020 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS), 2020,
  • [36] Simple very deep convolutional network for robust hand pose regression from a single depth image
    Fan, Qing
    Shen, Xukun
    Hu, Yong
    Yu, Changjian
    PATTERN RECOGNITION LETTERS, 2019, 119 : 205 - 213
  • [37] Structure-Aware 3D Hand Pose Regression from a Single Depth Image
    Malik, Jameel
    Elhayek, Ahmed
    Stricker, Didier
    VIRTUAL REALITY AND AUGMENTED REALITY, EUROVR 2018, 2018, 11162 : 3 - 17
  • [38] Controlled human pose estimation from depth image streams
    Zhu, Youding
    Dariush, Behzad
    Fujimura, Kikuo
    2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1544 - +
  • [39] Mask-Pose Cascaded CNN for 2D Hand Pose Estimation From Single Color Image
    Wang, Yangang
    Peng, Cong
    Liu, Yebin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (11) : 3258 - 3268
  • [40] 3D interacting hand pose and shape estimation from a single RGB image
    Gao, Chengying
    Yang, Yujia
    Li, Wensheng
    NEUROCOMPUTING, 2022, 474 : 25 - 36