Smart Presentation System using Hand Gestures and Indonesian Speech Command

被引:0
|
作者
Wardhany, Vivien Arief [1 ]
Kurnia, Muhammad Hendrick [1 ]
Sukaridhoto, Sritrusta [1 ]
Sudarsono, Amang [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politeknik Elekt Negeri Surabaya, Surabaya, Indonesia
关键词
Smart presentation system; hand; gestures; speech recognition;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The development of technology for supporting learning system at this time takes place very rapidly. Human Computer Interaction provides users that allows to control presentations in a natural way by their body gestures and voice commands. The authors propose a simple system that can be use to control presentation by using hand gestures and also by using Indonesian speech recognition. Our proposed system consist of gesture recognition with Kinect 3D skeletal data, and utilize Google Speech API to recognize Indonesian language as voice command. In this system we built applications to perform hand gestures and speech recognitions and utilize libraries to perform mouse and keyboard actions in presentation application. From the experiments, hand gestures application can process in realtime with the accuracy more than 90%, and for Indonesian language speech recognition gave accuracy almost 99% with average speed of recognition around 1 second.
引用
收藏
页码:68 / 72
页数:5
相关论文
共 50 条
  • [41] Neuropsychological functions of hand movements and gestures change in the presence or absence of speech
    Helmich, I.
    Skomroch, H.
    Lausberg, H.
    JOURNAL OF COGNITIVE PSYCHOLOGY, 2014, 26 (07) : 740 - 753
  • [42] Development of benchmark datasets of multioriented hand gestures for speech and hearing disabled
    Soumi Paul
    Hayat Nasser
    Ayatullah Faruk Mollah
    Arpan Bhattacharyya
    Phuc Ngo
    Mita Nasipuri
    Isabelle Debled-Rennesson
    Subhadip Basu
    Multimedia Tools and Applications, 2022, 81 : 7285 - 7321
  • [43] Effects of different types of hand gestures in persuasive speech on receivers' evaluations
    Maricchiolo, Fridanna
    Gnisci, Augusto
    Bonaiuto, Marino
    Ficca, Gianluca
    LANGUAGE AND COGNITIVE PROCESSES, 2009, 24 (02): : 239 - 266
  • [44] Development of benchmark datasets of multioriented hand gestures for speech and hearing disabled
    Paul, Soumi
    Nasser, Hayat
    Mollah, Ayatullah Faruk
    Bhattacharyya, Arpan
    Ngo, Phuc
    Nasipuri, Mita
    Debled-Rennesson, Isabelle
    Basu, Subhadip
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) : 7285 - 7321
  • [45] Differential diagnosis of severe speech disorders using speech gestures
    Bahr, RH
    TOPICS IN LANGUAGE DISORDERS, 2005, 25 (03) : 254 - 265
  • [46] Smart home interactions for people with reduced hand mobility using subtle EMG-Signal gestures
    Vasylkiv Y.
    Neshati A.
    Sakamoto Y.
    Gomez R.
    Nakamura K.
    Irani P.
    Studies in Health Technology and Informatics, 2019, 257 : 436 - 443
  • [47] Sign Language Recognition using Hand Gestures
    Lohith, D. S.
    Raj, Nitin
    PROCEEDINGS OF THE 2021 FIFTH INTERNATIONAL CONFERENCE ON I-SMAC (IOT IN SOCIAL, MOBILE, ANALYTICS AND CLOUD) (I-SMAC 2021), 2021, : 968 - 971
  • [48] Recognition of hand gestures using range images
    Umeda, K
    Furusawa, I
    Tanaka, S
    1998 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS - PROCEEDINGS, VOLS 1-3: INNOVATIONS IN THEORY, PRACTICE AND APPLICATIONS, 1998, : 1727 - 1732
  • [49] Human Computer Interaction Using Hand Gestures
    Premaratne, Prashan
    Quang Nguyen
    Premaratne, Malin
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, 2010, 93 : 381 - +
  • [50] Object manipulation and deformation using hand gestures
    Khadijeh Mahdikhanlou
    Hossein Ebrahimnezhad
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 8115 - 8133