A lightweight gesture recognition network

被引:0
|
作者
Guo, Jinzhao [1 ]
Lei, Xuemei [1 ]
Li, Bo [1 ]
机构
[1] Inner Mongolia Univ, Hohhot 010021, Peoples R China
关键词
Gesture recognition; Lightweight model; Computation; Detection accuracy; Key features;
D O I
10.1016/j.jvcir.2024.104362
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As one of the main human-computer interaction methods, gesture recognition has an urgent issue to be addressed, which huge paramaters and massive computation of the classification and recognition algorithm cause high cost in practical applications. To reduce cost and enhance the detection efficiency, a lightweight model of gesture recognition algorithms is proposed in this paper, based on the YOLOv5s framework. Firstly, we adopt ShuffleNetV2 as the backbone network to reduce the computational load and enhance the model's detection speed. Additionally, lightweight modules such as GSConv and VoVGSCSP are introduced into the neck network to further compress the model size while maintaining accuracy. Furthermore, the BiFPN (Bi-directional Feature Pyramid Network) structure is incorporated to enhance the network's detection accuracy at a lower computational cost. Lastly, we introduce the Coordinate Attention (CA) mechanism to enhance the network's focus on key features. To investigate the rationale behind the introduction of the CA attention mechanism and the BiFPN network structure, we analyze the extracted features and validate the network's attention on different parts of the feature maps through visualization. Experimental results demonstrate that the proposed algorithm achieves an average precision of 95.2% on the HD-HaGRID dataset. Compared to the original YOLOv5s model, the proposal model reduces the parameter count by 70.6% and the model size by 69.2%. Therefore, this model is suitable for real-time gesture recognition classification and detection, demonstrating significant potential for practical applications.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Medical Gesture Recognition Method Based on Improved Lightweight Network
    Wang, Wenjie
    He, Mengling
    Wang, Xiaohua
    Song, Huajian
    Ma, Jianwei
    SSRN, 2022,
  • [2] An Approach for Gesture Recognition Based on a Lightweight Convolutional Neural Network
    Ravinder, M.
    Malik, Kiran
    Hassaballah, M.
    Tariq, Usman
    Javed, Kashif
    Ghoneimy, Mohamed
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2023, 32 (03)
  • [3] Radar Gesture Recognition Based on Lightweight Convolutional Neural Network
    Dong, Yaoyao
    Qu, Wei
    Wang, Pengda
    Jiang, Haohao
    Gao, Tianhao
    Shu, Yanhe
    SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [4] Medical Gesture Recognition Method Based on Improved Lightweight Network
    Wang, Wenjie
    He, Mengling
    Wang, Xiaohua
    Ma, Jianwei
    Song, Huajian
    APPLIED SCIENCES-BASEL, 2022, 12 (13):
  • [5] A Lightweight Network Deployed on ARM Devices for Hand Gesture Recognition
    Zhang, Mingyue
    Zhou, Zhiheng
    Wang, Tianlei
    Zhou, Wenlve
    IEEE ACCESS, 2023, 11 : 45493 - 45503
  • [6] FGDSNet: A Lightweight Hand Gesture Recognition Network for Human Robot Interaction
    Zhou, Guoyu
    Cui, Zhenchao
    Qi, Jing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (04): : 3076 - 3083
  • [7] A lightweight architecture for hand gesture recognition
    Dang, Tuan Linh
    Pham, Trung Hieu
    Dang, Quang Minh
    Monet, Nicolas
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (18) : 28569 - 28587
  • [8] A lightweight architecture for hand gesture recognition
    Tuan Linh Dang
    Trung Hieu Pham
    Quang Minh Dang
    Nicolas Monet
    Multimedia Tools and Applications, 2023, 82 : 28569 - 28587
  • [9] Gesture-ProxylessNAS: A Lightweight Network for Mid-Air Gesture Recognition Based on UWB Radar
    Qiao, Lihong
    Li, Zhixin
    Xiao, Bin
    Shu, Yucheng
    Li, Weisheng
    Gao, Xinbo
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5144 - 5153
  • [10] A lightweight hand gesture recognition in complex backgrounds
    Zhou, Weina
    Chen, Kun
    DISPLAYS, 2022, 74