Real-time hand gestures system based on leap motion

被引:7
|
作者
Jia, Jing [1 ]
Tu, Geng [1 ]
Deng, Xin [2 ]
Zhao, Chuchu [2 ]
Yi, Wenlong [1 ]
机构
[1] Jiangxi Agr Univ, Sch Software, Nanchang 330045, Jiangxi, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
gesture recognition; HMM; leap motion; SVM; RECOGNITION;
D O I
10.1002/cpe.4898
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In the three-dimensional human-computer interaction, the identification of dynamic and static gestures is a very important and challenging work in the field of machine vision, In this paper, we propose a new gesture recognition system. Leap Motion device is a kind of equipment, which is specially used for hand recognition, which can get the feature data to realize the gesture recognition in real time. The system is mainly composed of the following two parts. For static gestures, we use a kind of feature information based on the distance, direction, and bending degree of the fingertip, and bring the support vector machine into the training to realize the static gesture recognition. For dynamic gestures, we use gesture length as a benchmark to reject non-key gestures and preprocess frames with abnormal gesture sequences. The average recognition rate of static gestures reaches 99.98%, and the recognition rate of dynamic gestures reaches 96.20%. The experimental results show that the algorithm has a good effect on gesture recognition, and it is suitable for the simple interaction between gestures, people and people and daily communication of daily communication barriers.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Real-time natural hand gestures
    Yi, BF
    Harris, FC
    Wang, L
    Yan, YS
    COMPUTING IN SCIENCE & ENGINEERING, 2005, 7 (03) : 92 - 96
  • [2] Real-Time Detection of Hand Gestures
    Muzyka, Piotr
    Frydrysiak, Marek
    Roszkowska, Elzbieta
    2016 21ST INTERNATIONAL CONFERENCE ON METHODS AND MODELS IN AUTOMATION AND ROBOTICS (MMAR), 2016, : 168 - 173
  • [3] Real-time Hand Gestures System for Mobile Robots Control
    Faudzi, Ahmad Athif Mohd
    Ali, Muaammar Hadi Kuzman
    Azman, M. Asyraf
    Ismail, Zool Hilmi
    INTERNATIONAL SYMPOSIUM ON ROBOTICS AND INTELLIGENT SENSORS 2012 (IRIS 2012), 2012, 41 : 798 - 804
  • [4] Real-time Motion-based Hand Gestures Recognition from Time-of-Flight Video
    Molina, Javier
    Antonio Pajuelo, Jose
    Martinez, Jose M.
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2017, 86 (01): : 17 - 25
  • [5] Real-time Motion-based Hand Gestures Recognition from Time-of-Flight Video
    Javier Molina
    José Antonio Pajuelo
    José M. Martínez
    Journal of Signal Processing Systems, 2017, 86 : 17 - 25
  • [6] Hand Swifter: A Real-Time Computer Controlling System Using Hand Gestures
    Sabab, Shahed Anzarus
    Islam, Sadman Saumik
    Hossain, Mainul
    Shahreen, Mahbuba
    2018 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATION & COMMUNICATION TECHNOLOGY (ICEEICT), 2018, : 9 - 14
  • [7] Two viewpoints based real-time recognition for hand gestures
    Kumar, Amit Krishan
    Kumar, Abhishek Kaushal
    Guo, Shuli
    IET IMAGE PROCESSING, 2020, 14 (17) : 4606 - 4613
  • [8] Real-Time Recognition of Sign Language Gestures and Air-Writing using Leap Motion
    Kumar, Pradeep
    Saini, Rajkumar
    Behera, Santosh Kumar
    Dogra, Debi Prosad
    Roy, Partha Pratim
    PROCEEDINGS OF THE FIFTEENTH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS - MVA2017, 2017, : 157 - 160
  • [9] Real-Time Hand Gesture Recognition Using the Leap Motion Controller and Machine Learning
    Nogales, Ruben
    Benalcazar, Marco
    2019 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2019,
  • [10] A Real-Time ASL Recognition System Using Leap Motion Sensors
    Fok, Kai-Yin
    Ganganath, Nuwan
    Cheng, Chi-Tsun
    Tse, Chi K.
    2015 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY, 2015, : 411 - 414