Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:32
|
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [41] Skeleton-Based Gesture Recognition With Learnable Paths and Signature Features
    Cheng, Jiale
    Shi, Dongzi
    Li, Chenyang
    Li, Yu
    Ni, Hao
    Jin, Lianwen
    Zhang, Xin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3951 - 3961
  • [42] A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices
    Lu, Zhiyuan
    Chen, Xiang
    Li, Qiang
    Zhang, Xu
    Zhou, Ping
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2014, 44 (02) : 293 - 299
  • [43] A HAND GESTURE-BASED INTERFACE FOR DESIGN REVIEW USING LEAP MOTION CONTROLLER
    Xiao Yu
    Peng Qingjin
    DS87-8 PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON ENGINEERING DESIGN (ICED 17), VOL 8: HUMAN BEHAVIOUR IN DESIGN, 2017, : 239 - 248
  • [44] Automatic 3D Skeleton-based Dynamic Hand Gesture Recognition Using Multi-Layer Convolutional LSTM
    Mohammed, Adam A. Q.
    Gao, Yuan
    Ji, Zhilong
    Lv, Jiancheng
    Islam, Md Sajjatul
    Sang, Yongsheng
    2021 7TH INTERNATIONAL CONFERENCE ON ROBOTICS AND ARTIFICIAL INTELLIGENCE, ICRAI 2021, 2021, : 8 - 14
  • [45] A Gesture-Based Interface and Active Cinema
    Chavez, Mark J.
    Kyaw, Aung Sithu
    AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION, PT II, 2011, 6975 : 309 - 310
  • [46] MVHANet: multi-view hierarchical aggregation network for skeleton-based hand gesture recognition
    Shaochen Li
    Zhenyu Liu
    Guifang Duan
    Jianrong Tan
    Signal, Image and Video Processing, 2023, 17 : 2521 - 2529
  • [47] MVHANet: multi-view hierarchical aggregation network for skeleton-based hand gesture recognition
    Li, Shaochen
    Liu, Zhenyu
    Duan, Guifang
    Tan, Jianrong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 2521 - 2529
  • [48] Dynamic gesture recognition based on kinect skeleton data
    Li, Changlong, 1600, ICIC Express Letters Office (05):
  • [49] Real-Time Monocular Skeleton-Based Hand Gesture Recognition Using 3D-Jointsformer
    Zhong, Enmin
    del-Blanco, Carlos R.
    Berjon, Daniel
    Jaureguizar, Fernando
    Garcia, Narciso
    SENSORS, 2023, 23 (16)
  • [50] Temporal Decoupling Graph Convolutional Network for Skeleton-Based Gesture Recognition
    Liu, Jinfu
    Wang, Xinshun
    Wang, Can
    Gao, Yuan
    Liu, Mengyuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 811 - 823