Real-time hand gestures system based on leap motion

被引:7
|
作者
Jia, Jing [1 ]
Tu, Geng [1 ]
Deng, Xin [2 ]
Zhao, Chuchu [2 ]
Yi, Wenlong [1 ]
机构
[1] Jiangxi Agr Univ, Sch Software, Nanchang 330045, Jiangxi, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
gesture recognition; HMM; leap motion; SVM; RECOGNITION;
D O I
10.1002/cpe.4898
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In the three-dimensional human-computer interaction, the identification of dynamic and static gestures is a very important and challenging work in the field of machine vision, In this paper, we propose a new gesture recognition system. Leap Motion device is a kind of equipment, which is specially used for hand recognition, which can get the feature data to realize the gesture recognition in real time. The system is mainly composed of the following two parts. For static gestures, we use a kind of feature information based on the distance, direction, and bending degree of the fingertip, and bring the support vector machine into the training to realize the static gesture recognition. For dynamic gestures, we use gesture length as a benchmark to reject non-key gestures and preprocess frames with abnormal gesture sequences. The average recognition rate of static gestures reaches 99.98%, and the recognition rate of dynamic gestures reaches 96.20%. The experimental results show that the algorithm has a good effect on gesture recognition, and it is suitable for the simple interaction between gestures, people and people and daily communication of daily communication barriers.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Real-time EMG-based Human Machine Interface Using Dynamic Hand Gestures
    Shin, Sungtae
    Tafreshi, Reza
    Langari, Reza
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 5456 - 5461
  • [32] Real-Time Grasp Type Recognition Using Leap Motion Controller
    Zou, Yuanyuan
    Liu, Honghai
    Zhang, Jilong
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT III, 2019, 11742 : 472 - 480
  • [33] Real-time simulation of hand motion for prosthesis control
    Blana, Dimitra
    Chadwick, Edward K.
    van den Bogert, Antonie J.
    Murray, Wendy M.
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2017, 20 (05) : 540 - 549
  • [34] Real-time recognition of hand alphabet gestures using principal component analysis
    Birk, H
    Moeslund, TB
    Madsen, CB
    SCIA '97 - PROCEEDINGS OF THE 10TH SCANDINAVIAN CONFERENCE ON IMAGE ANALYSIS, VOLS 1 AND 2, 1997, : 261 - 268
  • [35] Comparing Dynamic Hand Rehabilitation Gestures in Leap Motion Using Multi-Dimensional Dynamic Time Warping
    Walugembe, Hussein
    Phillips, Chris
    Requena-Carrion, Jesus
    Timotijevic, Tijana
    IEEE SENSORS JOURNAL, 2021, 21 (06) : 8002 - 8010
  • [36] The Manipulation of Real-Time Kinect-Based Robotic Arm Using Double-Hand Gestures
    Lin, Chern-Sheng
    Chen, Pei-Chi
    Pan, Yu-Ching
    Chang, Che-Ming
    Huang, Kuo-Liang
    JOURNAL OF SENSORS, 2020, 2020
  • [37] Leap-Motion Based Online Interactive System for Hand Rehabilitation
    Liu, Zhe
    Zhang, Yingzhi
    Rau, Pei-Luen Patrick
    Choe, Pilsung
    Gulrez, Tauseef
    CROSS-CULTURAL DESIGN: APPLICATIONS IN MOBILE INTERACTION, EDUCATION, HEALTH, TRANSPORT AND CULTURAL HERITAGE, CCD 2015, PT II, 2015, 9181 : 338 - 347
  • [38] Real Time Hand Gesture Recognition Using Leap Motion Controller Based on CNN-SVM Architechture
    Ikram, Aamrah
    Liu, Yue
    2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 5 - 9
  • [39] Hand Gesture Based Robot Control System Using Leap Motion
    Chen, Sunjie
    Ma, Hongbin
    Yang, Chenguang
    Fu, Mengyin
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2015, PT I, 2015, 9244 : 581 - 591
  • [40] EMG WRIST-HAND MOTION RECOGNITION SYSTEM FOR REAL-TIME EMBEDDED PLATFORM
    Raurale, Sumit
    McAllister, John
    del Rincon, Jesus Martinez
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1523 - 1527