Smart Presentation System using Hand Gestures and Indonesian Speech Command

被引:0
|
作者
Wardhany, Vivien Arief [1 ]
Kurnia, Muhammad Hendrick [1 ]
Sukaridhoto, Sritrusta [1 ]
Sudarsono, Amang [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politeknik Elekt Negeri Surabaya, Surabaya, Indonesia
关键词
Smart presentation system; hand; gestures; speech recognition;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The development of technology for supporting learning system at this time takes place very rapidly. Human Computer Interaction provides users that allows to control presentations in a natural way by their body gestures and voice commands. The authors propose a simple system that can be use to control presentation by using hand gestures and also by using Indonesian speech recognition. Our proposed system consist of gesture recognition with Kinect 3D skeletal data, and utilize Google Speech API to recognize Indonesian language as voice command. In this system we built applications to perform hand gestures and speech recognitions and utilize libraries to perform mouse and keyboard actions in presentation application. From the experiments, hand gestures application can process in realtime with the accuracy more than 90%, and for Indonesian language speech recognition gave accuracy almost 99% with average speed of recognition around 1 second.
引用
收藏
页码:68 / 72
页数:5
相关论文
共 50 条
  • [31] Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech
    ter Bekke, Marlijn
    Drijvers, Linda
    Holler, Judith
    COGNITIVE SCIENCE, 2024, 48 (01)
  • [32] Temporal symbolic integration applied to a multimodal system using gestures and speech
    Sowa, T
    Fröhlich, M
    Latoschik, ME
    GESTURE-BASED COMMUNICATION IN HUMAN-COMPUTER INTERACTION, 1999, 1739 : 291 - 302
  • [33] A pedagogical note on teaching L2 prosody and speech sounds using hand gestures
    Li, Peng
    Baills, Florence
    Alazard-Guiu, Charlotte
    Baque, Lorraine
    Prieto, Pilar
    JOURNAL OF SECOND LANGUAGE PRONUNCIATION, 2023, 9 (03) : 340 - 349
  • [34] MAPPING GESTURES TO SPEECH USING THE KINECT
    Muttena, Sanjivi
    Sriram, S.
    Shiva, R.
    2014 International Conference on Science Engineering and Management Research (ICSEMR), 2014,
  • [35] Presentation Sensei: A Presentation Training System using Speech and Image Processing
    Kurihara, Kazutaka
    Goto, Masataka
    Ogata, Jun
    Matsusaka, Yosuke
    Igarashi, Takeo
    ICMI'07: PROCEEDINGS OF THE NINTH INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES, 2007, : 358 - +
  • [36] A voice command system for AUTONOMY using a novel speech alignment algorithm
    Hickersberger H.
    Zagler W.L.
    International Journal of Speech Technology, 2013, 16 (4) : 461 - 469
  • [37] An Overview of Hand Gestures Recognition System Techniques
    Ma'asum, Farah Farhana Mod
    Sulaiman, Suhana
    Saparon, Azilah
    4TH INTERNATIONAL CONFERENCE ON ELECTRONIC DEVICES, SYSTEMS AND APPLICATIONS 2015 (ICEDSA), 2015, 99
  • [38] Smart Gloves for Hand Gesture Recognition Sign Language to Speech Conversion System
    Bhaskaran, Abhijith K.
    Nair, Anoop G.
    Ram, Deepak K.
    Ananthanarayanan, Krishnan
    Vardhan, H. R. Nandi
    2016 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION FOR HUMANITARIAN APPLICATIONS (RAHA), 2016, : 226 - 231
  • [39] A System for Controlling Personal Computers by Hand Gestures using a Wireless Sensor Device
    Yamagishi, Kaoru
    Jing, Lei
    Cheng, Zixue
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INDEPENDENT COMPUTING (ISIC), 2014, : 109 - 115
  • [40] Investigation of the Reationship between Hand Gestures and Speech in Adults Who Stutter
    Barikrou, Ali
    Rezaei, Nasser
    Yadegari, Fariba
    Rahgozar, Mehdi
    ARCHIVES OF REHABILITATION, 2009, 9 (3-4): : 16 - 21