LGCANet: lightweight hand pose estimation network based on HRNet

被引:0
|
作者
Pan, Xiaoying [1 ,2 ]
Li, Shoukun [1 ,2 ]
Wang, Hao [3 ,4 ]
Wang, Beibei [1 ,2 ]
Wang, Haoyi [5 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian 710072, Shaanxi, Peoples R China
[4] Northwestern Polytech Univ, Natl Engn Lab Air Earth Sea Integrat Big Data Appl, Xian 710121, Shaanxi, Peoples R China
[5] Southwest Univ, Westa Coll, Chongqing, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 13期
关键词
Hand pose estimation; High-resolution network; Multi-scale feature fusion; Lightweight network;
D O I
10.1007/s11227-024-06226-2
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Hand pose estimation is a fundamental task in computer vision with applications in virtual reality, gesture recognition, autonomous driving, and virtual surgery. Keypoint detection often relies on deep learning methods and high-resolution feature map representations to achieve accurate detection. The HRNet framework serves as the basis, but it presents challenges in terms of extensive parameter count and demanding computational complexity due to high-resolution representations. To mitigate these challenges, we propose a lightweight keypoint detection network called LGCANet (Lightweight Ghost-Coordinate Attention Network). This network primarily consists of a lightweight feature extraction head for initial feature extraction and multiple lightweight foundational network modules called GCAblocks. GCAblocks introduce linear transformations to generate redundant feature maps while concurrently considering inter-channel relationships and long-range positional information using a coordinate attention mechanism. Validation on the RHD dataset and the COCO-WholeBody-Hand dataset shows that LGCANet reduces the number of parameters by 65.9% and GFLOPs by 72.6% while preserving the accuracy and improves the detection speed.
引用
收藏
页码:19351 / 19373
页数:23
相关论文
共 50 条
  • [21] Pose estimation and motion analysis of ski jumpers based on ECA-HRNet
    Bao, Wenxia
    Niu, Tao
    Wang, Nian
    Yang, Xianjun
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [22] Pose estimation and motion analysis of ski jumpers based on ECA-HRNet
    Wenxia Bao
    Tao Niu
    Nian Wang
    Xianjun Yang
    Scientific Reports, 13
  • [23] Pose Estimation and Behavior Classification of Jinling White Duck Based on Improved HRNet
    Zhao, Shida
    Bai, Zongchun
    Meng, Lili
    Han, Guofeng
    Duan, Enze
    ANIMALS, 2023, 13 (18):
  • [24] BaSICNet: Lightweight 3-D Hand Pose Estimation Network Based on Biomechanical Structure Information for Dexterous Manipulator Teleoperation
    Pang, Wenrao
    Gao, Qing
    Zhao, Yinan
    Ju, Zhaojie
    Hu, Junjie
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (02) : 448 - 457
  • [25] Lightweight head pose estimation without keypoints based on multi-scale lightweight neural network
    Xiaolei Chen
    Yubing Lu
    Baoning Cao
    Dongmei Lin
    Ishfaq Ahmad
    The Visual Computer, 2023, 39 (6) : 2455 - 2469
  • [26] Lightweight head pose estimation without keypoints based on multi-scale lightweight neural network
    Chen, Xiaolei
    Lu, Yubing
    Cao, Baoning
    Lin, Dongmei
    Ahmad, Ishfaq
    VISUAL COMPUTER, 2023, 39 (06): : 2455 - 2469
  • [27] Human pose estimation based on lightweight basicblock
    Yanping Li
    Ruyi Liu
    Xiangyang Wang
    Rui Wang
    Machine Vision and Applications, 2023, 34
  • [28] Human Pose Estimation via an Ultra-Lightweight Pose Distillation Network
    Zhang, Shihao
    Qiang, Baohua
    Yang, Xianyi
    Wei, Xuekai
    Chen, Ruidong
    Chen, Lirui
    ELECTRONICS, 2023, 12 (12)
  • [29] Human pose estimation based on lightweight basicblock
    Li, Yanping
    Liu, Ruyi
    Wang, Xiangyang
    Wang, Rui
    MACHINE VISION AND APPLICATIONS, 2023, 34 (01)
  • [30] A lightweight model of pose estimation based on DenseFusion
    Yu, Chongchong
    Chen, Jialun
    Hu, Xinyu
    Feng, Wenbin
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 5688 - 5693