Learning dynamic relationship between joints for 3D hand pose estimation from single depth map

被引:1
|
作者
Xing, Huiqin [1 ]
Yang, Jianyu [1 ]
Xiao, Yang [2 ]
机构
[1] Soochow Univ, Sch Rail Transportat, 8 Jixue Rd, Suzhou 215131, Jiangsu, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430000, Hubei, Peoples R China
关键词
Hand pose estimation; Dynamic anchor; Hand gesture; Depth map;
D O I
10.1016/j.jvcir.2023.103803
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D hand pose estimation from a single depth map is an essential topic in computer vision. Most existing methods are devoted to designing a model to capture more spatial information or designing loss functions based on prior knowledge to constrain the estimated pose with prior spatial information. In this work, we focus on constraining the estimation process with spatial information adaptively by learning the mutual position relationship between joint pairs. Specifically, we propose a dynamic relationship network (DRN) with dynamic anchors. The preset fixed anchors are employed to estimate the position of each joint initially. Then, each joint is considered a dynamic anchor, which plays the role of a dynamic regressor to adjust the initially estimated position of each joint. The final estimation of each joint is the weighted sum of the results from all the dynamic anchors. Extensive experiments on benchmarks demonstrate that our method provides competitive results compared with state-of-the-arts.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Modeling Static and Dynamic Joint Relationship for 3D Pose Estimation
    Liu, Qiong
    He, Jianhang
    Wen, Jiaxiao
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (05): : 35 - 43
  • [42] Dynamic Graph CNN with Attention Module for 3D Hand Pose Estimation
    Jiang, Xu
    Ma, Xiaohong
    ADVANCES IN NEURAL NETWORKS - ISNN 2019, PT I, 2019, 11554 : 87 - 96
  • [43] 3D hand pose estimation from a single RGB image by weighting the occlusion and classification
    Mahdikhanlou, Khadijeh
    Ebrahimnezhad, Hossein
    PATTERN RECOGNITION, 2023, 136
  • [44] Occlusion-Robust 3D Hand Pose Estimation from a Single RGB Image
    Ishii, Asuka
    Nakano, Gaku
    Inoshita, Tetsuo
    PROCEEDINGS OF 17TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA 2021), 2021,
  • [45] 3D human pose and shape estimation with dense correspondence from a single depth image
    Wang, Kangkan
    Zhang, Guofeng
    Yang, Jian
    VISUAL COMPUTER, 2023, 39 (01): : 429 - 441
  • [46] 3D human pose and shape estimation with dense correspondence from a single depth image
    Kangkan Wang
    Guofeng Zhang
    Jian Yang
    The Visual Computer, 2023, 39 : 429 - 441
  • [47] 3D Hand Pose Estimation Using a Single Camera for Unspecified Users
    Hoshino, Kiyoshi
    Tomida, Motomasa
    JOURNAL OF ROBOTICS AND MECHATRONICS, 2009, 21 (06) : 749 - 757
  • [48] Lightweight 3D hand pose estimation by cascading CNNs with reinforcement learning
    Chen, Mingqi
    Li, Shaodong
    Shuang, Feng
    Liu, Xi
    Luo, Kai
    He, Wenbo
    PATTERN RECOGNITION LETTERS, 2023, 174 : 137 - 144
  • [49] Learning Sequential Contexts using Transformer for 3D Hand Pose Estimation
    Khaleghi, Leyla
    Marshall, Joshua
    Etemad, Ali
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 535 - 541
  • [50] Denoising Diffusion for 3D Hand Pose Estimation from Images
    Ivashechkin, Maksym
    Mendez, Oscar
    Bowden, Richard
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3128 - 3137