Smart Presentation System using Hand Gestures and Indonesian Speech Command

被引:0
|
作者
Wardhany, Vivien Arief [1 ]
Kurnia, Muhammad Hendrick [1 ]
Sukaridhoto, Sritrusta [1 ]
Sudarsono, Amang [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politeknik Elekt Negeri Surabaya, Surabaya, Indonesia
关键词
Smart presentation system; hand; gestures; speech recognition;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The development of technology for supporting learning system at this time takes place very rapidly. Human Computer Interaction provides users that allows to control presentations in a natural way by their body gestures and voice commands. The authors propose a simple system that can be use to control presentation by using hand gestures and also by using Indonesian speech recognition. Our proposed system consist of gesture recognition with Kinect 3D skeletal data, and utilize Google Speech API to recognize Indonesian language as voice command. In this system we built applications to perform hand gestures and speech recognitions and utilize libraries to perform mouse and keyboard actions in presentation application. From the experiments, hand gestures application can process in realtime with the accuracy more than 90%, and for Indonesian language speech recognition gave accuracy almost 99% with average speed of recognition around 1 second.
引用
收藏
页码:68 / 72
页数:5
相关论文
共 50 条
  • [1] Smart Virtual Lab Using Hand Gestures
    Ikram, Warda
    Jeong, Yoonji
    Lee, Byeonggwon
    Um, Kyhyun
    Cho, Kyungeun
    Advanced Multimedia and Ubiquitous Engineering: Future Information Technology, 2015, 352 : 165 - 170
  • [2] Using arm and hand gestures to command robots during stealth operations
    Stoica, Adrian
    Assad, Chris
    Wolf, Michael
    You, Ki Sung
    Pavone, Marco
    Huntsberger, Terry
    Iwashita, Yumi
    MULTISENSOR, MULTISOURCE INFORMATION FUSION: ARCHITECTURES, ALGORITHMS, AND APPLICATIONS 2012, 2012, 8407
  • [3] Hand Gestures Recognition for an Intelligent Wheelchair Steering Command
    Almeida, Patricia
    Faria, Brigida Monica
    Reis, Luis Paulo
    ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 2, 2023, 590 : 41 - 52
  • [4] Automatic Estimation of Presentation Skills Using Speech, Slides and Gestures
    Hanani, Abualsoud
    Al-Amleh, Mohammad
    Bazbus, Waseem
    Salameh, Saleem
    SPEECH AND COMPUTER, SPECOM 2017, 2017, 10458 : 182 - 191
  • [5] The Use of Hand Gestures as a Tool for Presentation
    Orovwode, Hope
    Abubakar, John Amanesi
    Gaius, Onuora Chidera
    Abdullkareem, Ademola
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (11) : 574 - 585
  • [6] Adaptive and smart interface for VCR Remote Control using hand gestures
    Duric, Z
    Wechsler, H
    Yven, J
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL III, PROCEEDINGS, 2002, : 1035 - 1038
  • [7] Indonesian Automatic Speech Recognition For Command Speech Controller Multimedia Player
    Wardhany, Vivien Arief
    Sukaridhoto, Sritrusta
    Sudarsono, Amang
    EMITTER-INTERNATIONAL JOURNAL OF ENGINEERING TECHNOLOGY, 2014, 2 (02) : 39 - 48
  • [8] Rhythmic commonalities between hand gestures and speech
    Cummins, F
    Port, RF
    PROCEEDINGS OF THE EIGHTEENTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, 1996, : 415 - 419
  • [9] Noncontact button operation system using hand gestures
    Li, Yujie
    Hanaoka, Osamu
    Yang, Shuo
    Serikawa, Seiichi
    Computers and Electrical Engineering, 2022, 97
  • [10] Noncontact button operation system using hand gestures
    Li, Yujie
    Hanaoka, Osamu
    Yang, Shuo
    Serikawa, Seiichi
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 97