Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:32
|
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [31] Skeleton-Based Hand Gesture Recognition by Using Multi-input Fusion Lightweight Network
    Hu, Qihao
    Gao, Qing
    Gao, Hongwei
    Ju, Zhaojie
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT I, 2022, 13455 : 24 - 34
  • [32] Developing a gesture-based interface
    Gupta, N
    Mittal, P
    Roy, SD
    Chaudhury, S
    Banerjee, S
    IETE JOURNAL OF RESEARCH, 2002, 48 (3-4) : 237 - 244
  • [33] Spatial-Temporal Attention Res-TCN for Skeleton-Based Dynamic Hand Gesture Recognition
    Hou, Jingxuan
    Wang, Guijin
    Chen, Xinghao
    Xue, Jing-Hao
    Zhu, Rui
    Yang, Huazhong
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 273 - 286
  • [34] Dynamic Hand Gesture Recognition Using the Skeleton of the Hand
    Bogdan Ionescu
    Didier Coquin
    Patrick Lambert
    Vasile Buzuloiu
    EURASIP Journal on Advances in Signal Processing, 2005
  • [35] Dynamic hand gesture recognition using the skeleton of the hand
    Ionescu, B
    Coquin, D
    Lambert, P
    Buzuloiu, V
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2005, 2005 (13) : 2101 - 2109
  • [36] Gesture recognition matching based on dynamic skeleton
    Wang Jingyao
    Yu Naigong
    Firdaous, Essaf
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1680 - 1685
  • [37] Normalize d e dge convolutional networks for skeleton-based hand gesture recognition
    Guo, Fangtai
    He, Zaixing
    Zhang, Shuyou
    Zhao, Xinyue
    Fang, Jinhui
    Tan, Jianrong
    PATTERN RECOGNITION, 2021, 118
  • [38] Learning Recurrent High-order Statistics for Skeleton-based Hand Gesture Recognition
    Nguyen, Xuan Son
    Brun, Luc
    Lezoray, Olivier
    Bougleux, Sebastien
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 975 - 982
  • [39] Hand Gesture Recognition based on Skeleton of Point Clouds
    Wu, Shen
    Jiang, Feng
    Zhao, Debin
    2012 IEEE FIFTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2012, : 566 - 569
  • [40] Hand gesture-based interface with multichannel sEMG band enabling unknown gesture discrimination
    Tomczynski, Jakub
    Kaczmarek, Piotr
    Mankowski, Tomasz
    2015 10TH INTERNATIONAL WORKSHOP ON ROBOT MOTION AND CONTROL (ROMOCO), 2015, : 52 - 57