Hierarchical topology based hand pose estimation from a single depth image

被引:3
|
作者
Ji, Yanli [1 ]
Li, Haoxin [1 ]
Yang, Yang [2 ]
Li, Shuying [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Automat Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Sichuan, Peoples R China
[3] China Aerosp Sci & Technol Corp, Inst 16, Xian, Shaanxi, Peoples R China
关键词
Hand pose estimation; Regression forest; Hierarchical topology; Pose refinement;
D O I
10.1007/s11042-017-4651-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hand pose estimation benefits large human computer interaction applications. The hand pose has high dimensions of freedom (dof) for joints, and various hand poses are flexible. Hand pose estimation is still a challenge problem. Since hand joints on the hand skeleton topology model have strict relationships between each other, we propose a hierarchical topology based approach to estimate 3D hand poses. First, we determine palm positions and palm orientations by detecting hand fingertips and calculating their directions in depth images. It is the global topology of hand poses. Moreover, we define connection relationships of finger joints as the local topology of hand model. Based on hierarchical topology, we extract angle features to describe hand poses, and adopt the regression forest algorithm to estimate 3D coordinates of hand joints. We further use freedom forrest algorithm to refine ambiguous poses in estimation to solve error accumulation problem. The hierarchical topology based approach ensures estimated hand poses in a reasonable topology, and improves estimation accuracy. We evaluate our approach on two public databases, and experiments illustrate its efficiency. Compared with state-of-the-art approaches, our approach improves estimation accuracy.
引用
收藏
页码:10553 / 10568
页数:16
相关论文
共 50 条
  • [41] MuTr: Multi-Stage Transformer for Hand Pose Estimation from Full-Scene Depth Image
    Kanis, Jakub
    Gruber, Ivan
    Krnoul, Zdenek
    Bohacek, Matyas
    Straka, Jakub
    Hruz, Marek
    SENSORS, 2023, 23 (12)
  • [42] ON THE FUSION OF RGB AND DEPTH INFORMATION FOR HAND POSE ESTIMATION
    Kazakos, Evangelos
    Nikou, Christophoros
    Kakadiaris, Ioannis A.
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 868 - 872
  • [43] HandFormer: Hand pose reconstructing from a single RGB image
    Jiao, Zixun
    Wang, Xihan
    Li, Jingcao
    Gao, Rongxin
    He, Miao
    Liang, Jiao
    Xia, Zhaoqiang
    Gao, Quanli
    PATTERN RECOGNITION LETTERS, 2024, 183 : 155 - 164
  • [44] SINGLE IMAGE DEPTH ESTIMATION FROM IMAGE DESCRIPTORS
    Lin, Yu-Hsun
    Cheng, Wen-Huang
    Miao, Hsin
    Ku, Tsung-Hao
    Hsieh, Yung-Huan
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 809 - 812
  • [45] Efficient Human Pose Estimation from Single Depth Images
    Shotton, Jamie
    Girshick, Ross
    Fitzgibbon, Andrew
    Sharp, Toby
    Cook, Mat
    Finocchio, Mark
    Moore, Richard
    Kohli, Pushmeet
    Criminisi, Antonio
    Kipman, Alex
    Blake, Andrew
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (12) : 2821 - 2840
  • [46] Augmented Skeleton Space Transfer for Depth-based Hand Pose Estimation
    Baek, Seungryul
    Kim, Kwang In
    Kim, Tae-Kyun
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8330 - 8339
  • [47] A Review of Human Pose Estimation from Single Image
    Khan, Naimat Ullah
    Wan, Wanggen
    2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2018, : 230 - 236
  • [48] OSiMa: Human Pose Estimation from a Single Image
    Pande, Nipun
    Guha, Prithwijit
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, 2011, 6744 : 200 - 205
  • [49] Pose Estimation of Non-Cooperative Target Based on Depth Image
    Sun Dianqi
    Pei Haodong
    Duan Huixian
    Hu Liang
    AOPC 2021: INFRARED DEVICE AND INFRARED TECHNOLOGY, 2021, 12061
  • [50] Distance constraint based iterative structure and pose estimation from a single image
    Rodrigues, MA
    Liu, YH
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2000, : 501 - 504