LGCANet: lightweight hand pose estimation network based on HRNet

被引:0
|
作者
Pan, Xiaoying [1 ,2 ]
Li, Shoukun [1 ,2 ]
Wang, Hao [3 ,4 ]
Wang, Beibei [1 ,2 ]
Wang, Haoyi [5 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian 710072, Shaanxi, Peoples R China
[4] Northwestern Polytech Univ, Natl Engn Lab Air Earth Sea Integrat Big Data Appl, Xian 710121, Shaanxi, Peoples R China
[5] Southwest Univ, Westa Coll, Chongqing, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 13期
关键词
Hand pose estimation; High-resolution network; Multi-scale feature fusion; Lightweight network;
D O I
10.1007/s11227-024-06226-2
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Hand pose estimation is a fundamental task in computer vision with applications in virtual reality, gesture recognition, autonomous driving, and virtual surgery. Keypoint detection often relies on deep learning methods and high-resolution feature map representations to achieve accurate detection. The HRNet framework serves as the basis, but it presents challenges in terms of extensive parameter count and demanding computational complexity due to high-resolution representations. To mitigate these challenges, we propose a lightweight keypoint detection network called LGCANet (Lightweight Ghost-Coordinate Attention Network). This network primarily consists of a lightweight feature extraction head for initial feature extraction and multiple lightweight foundational network modules called GCAblocks. GCAblocks introduce linear transformations to generate redundant feature maps while concurrently considering inter-channel relationships and long-range positional information using a coordinate attention mechanism. Validation on the RHD dataset and the COCO-WholeBody-Hand dataset shows that LGCANet reduces the number of parameters by 65.9% and GFLOPs by 72.6% while preserving the accuracy and improves the detection speed.
引用
收藏
页码:19351 / 19373
页数:23
相关论文
共 50 条
  • [41] LSDNet: lightweight stochastic depth network for human pose estimation
    Zhang, Hengrui
    Qi, Yongfeng
    Chen, Huili
    Cao, Panpan
    Liang, Anye
    Wen, Shengcong
    VISUAL COMPUTER, 2025, 41 (01): : 257 - 270
  • [42] Lightweight densely connected residual network for human pose estimation
    Yang, Lianping
    Qin, Yu
    Zhang, Xiangde
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (03) : 825 - 837
  • [43] Lightweight Multi-Resolution Network for Human Pose Estimation
    Li, Pengxin
    Wang, Rong
    Zhang, Wenjing
    Liu, Yinuo
    Xu, Chenyue
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 138 (03): : 2239 - 2255
  • [44] A lightweight convolutional neural network for pose estimation of a planar model
    Ocegueda-Hernandez, Vladimir
    Roman-Godinez, Israel
    Mendizabal-Ruiz, Gerardo
    MACHINE VISION AND APPLICATIONS, 2022, 33 (03)
  • [45] LDNet: Lightweight dynamic convolution network for human pose estimation
    Xu, Dingning
    Zhang, Rong
    Guo, Lijun
    Feng, Cun
    Gao, Shangce
    ADVANCED ENGINEERING INFORMATICS, 2022, 54
  • [46] Lightweight densely connected residual network for human pose estimation
    Lianping Yang
    Yu Qin
    Xiangde Zhang
    Journal of Real-Time Image Processing, 2021, 18 : 825 - 837
  • [47] A lightweight convolutional neural network for pose estimation of a planar model
    Vladimir Ocegueda-Hernández
    Israel Román-Godínez
    Gerardo Mendizabal-Ruiz
    Machine Vision and Applications, 2022, 33
  • [48] SESPnet: a lightweight network with attention mechanism for spacecraft pose estimation
    Chen C.
    Jing Z.
    Pan H.
    Dun X.
    Huang J.
    Wu H.
    Cao S.
    Aerospace Systems, 2024, 7 (01) : 1 - 10
  • [49] Pose guided structured region ensemble network for cascaded hand pose estimation
    Chen, Xinghao
    Wang, Guijin
    Guo, Hengkai
    Zhang, Cairong
    NEUROCOMPUTING, 2020, 395 (395) : 138 - 149
  • [50] Efficient Pose Estimation via a Lightweight Single-Branch Pose Distillation Network
    Zhang, Shihao
    Qiang, Baohua
    Yang, Xianyi
    Zhou, Mingliang
    Chen, Ruidong
    Chen, Lirui
    IEEE SENSORS JOURNAL, 2023, 23 (22) : 27709 - 27719