Smart Presentation System using Hand Gestures and Indonesian Speech Command

被引:0
|
作者
Wardhany, Vivien Arief [1 ]
Kurnia, Muhammad Hendrick [1 ]
Sukaridhoto, Sritrusta [1 ]
Sudarsono, Amang [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politeknik Elekt Negeri Surabaya, Surabaya, Indonesia
关键词
Smart presentation system; hand; gestures; speech recognition;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The development of technology for supporting learning system at this time takes place very rapidly. Human Computer Interaction provides users that allows to control presentations in a natural way by their body gestures and voice commands. The authors propose a simple system that can be use to control presentation by using hand gestures and also by using Indonesian speech recognition. Our proposed system consist of gesture recognition with Kinect 3D skeletal data, and utilize Google Speech API to recognize Indonesian language as voice command. In this system we built applications to perform hand gestures and speech recognitions and utilize libraries to perform mouse and keyboard actions in presentation application. From the experiments, hand gestures application can process in realtime with the accuracy more than 90%, and for Indonesian language speech recognition gave accuracy almost 99% with average speed of recognition around 1 second.
引用
收藏
页码:68 / 72
页数:5
相关论文
共 50 条
  • [21] Intelligent recognition system for hand gestures
    Honda, Yuichiro
    Weber, Stefan
    Lueth, Tim C.
    2007 3RD INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING, VOLS 1 AND 2, 2007, : 611 - +
  • [22] Command Strokes with and without Preview: Using Pen Gestures on Keyboard for Command Selection
    Kristensson, Per Ola
    Zhai, Shumin
    CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1 AND 2, 2007, : 1137 - 1146
  • [23] Indonesian Text-To-Speech System Using Syllable Concatenation: Speech Optimization
    Mengko, Richard
    Ayuningtyas, Aulia
    PROCEEDINGS OF 2013 3RD INTERNATIONAL CONFERENCE ON INSTRUMENTATION, COMMUNICATIONS, INFORMATION TECHNOLOGY, AND BIOMEDICAL ENGINEERING (ICICI-BME), 2013, : 412 - 415
  • [24] EFFECTS OF ELIMINATION OF HAND GESTURES AND OF VERBAL CODABILITY ON SPEECH PERFORMANCE
    GRAHAM, JA
    HEYWOOD, S
    EUROPEAN JOURNAL OF SOCIAL PSYCHOLOGY, 1975, 5 (02) : 189 - 195
  • [25] Hand Gestures and Speech Mapping of a Digital Camera For Differently Abled
    Kumar, Arun
    Pandey, Anurag
    2016 IEEE 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (IACC), 2016, : 392 - 397
  • [26] Speech Generation from Hand Gestures Based on Space Mapping
    Kunikoshi, Aki
    Qiao, Yu
    Minematsu, Nobuaki
    Hirose, Keikichi
    INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 260 - 263
  • [27] Iconic hand gestures and the predictability of words in context in spontaneous speech
    Beattie, G
    Shovelton, H
    BRITISH JOURNAL OF PSYCHOLOGY, 2000, 91 : 473 - 491
  • [28] The message notification for patients care system using hand gestures recognition
    Inmoonnoy, Vassana
    Ketcham, Mahasak
    2017 INTERNATIONAL CONFERENCE ON DIGITAL ARTS, MEDIA AND TECHNOLOGY (ICDAMT): DIGITAL ECONOMY FOR SUSTAINABLE GROWTH, 2017, : 412 - 416
  • [29] WORD FAMILIARITY PREDICTS TEMPORAL ASYNCHRONY OF HAND GESTURES AND SPEECH
    MORRELSAMUELS, P
    KRAUSS, RM
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 1992, 18 (03) : 615 - 622
  • [30] Static Hand Gestures Recognition System using Shape based Features
    Khurana, Garima
    Joshi, Garima
    Kaur, Jatinderpal
    2014 RECENT ADVANCES IN ENGINEERING AND COMPUTATIONAL SCIENCES (RAECS), 2014,