Teleoperation of a Virtual iCub Robot under Framework of Parallel System via Hand Gesture Recognition

被引:0
|
作者
Li, Chen [1 ]
Ma, Hongbin [1 ]
Yang, Chenguang [1 ,2 ]
Fu, Menyin [1 ]
机构
[1] Beijing Inst Technol, State Key Lab Intelligent Control & Decis Complex, Sch Automat, Beijing 100081, Peoples R China
[2] Univ Plymouth, Sch Comp & Math, Plymouth PL4 8AA, Devon, England
基金
英国工程与自然科学研究理事会;
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper describes our preliminary development of a virtual robot teleoperation platform based on hand gesture recognition using visual information. Hand gestures in images captured by a camera are recognised to control a virtual iCub. We employ two methods to realise the classification: Adaptive Neuro-fuzzy Inference Systems (ANFIS) and Support Vector Machines (SVM). We realise the teleoperation of a virtual robot using iCubSimulator. The technique in the paper will enable us to teleoperate a physical robot in the future work. In addition, a video server is set up to monitor the real robot. By using the parallel system we are able to improve the robot's performance. Based on the techniques presented in this paper, the virtual iCub can perform the specified actions remotely in a natural manner.
引用
收藏
页码:1469 / 1474
页数:6
相关论文
共 50 条
  • [1] Virtual hand -: Hand gesture recognition system
    Vamossy, Zoltan
    Toth, Andras
    Benedek, Balazs
    2007 5TH INTERNATIONAL SYMPOSIUM ON INTELLIGENT SYSTEMS & INFORMATICS, 2007, : 82 - 87
  • [2] Gesture Recognition for Humanoid Robot Teleoperation
    Ajili, Insaf
    Mallem, Malik
    Didier, Jean-Yves
    2017 26TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2017, : 1115 - 1120
  • [3] Gesture recognition for teleoperation and virtual environments
    Avizzano, CA
    Bergamasco, M
    TELEMANIPULATOR AND TELEPRESENCE TECHNOLOGIES VI, 1999, 3840 : 37 - 45
  • [4] An Efficient RGB-D Hand Gesture Detection Framework for Dexterous Robot Hand-Arm Teleoperation System
    Gao, Qing
    Ju, Zhaojie
    Chen, Yongquan
    Wang, Qiwen
    Chi, Chuliang
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2023, 53 (01) : 13 - 23
  • [5] A Multimode Teleoperation Framework for Humanoid Loco-Manipulation: An Application for the iCub Robot
    Penco, Luigi
    Scianca, Nicola
    Modugno, Valerio
    Lanari, Leonardo
    Oriolo, Giuseppe
    Ivaldi, Serena
    IEEE ROBOTICS & AUTOMATION MAGAZINE, 2019, 26 (04) : 73 - 82
  • [6] The Study of Teleoperation Technology Based on Hand Gesture Recognition
    Lin, Wanhong
    Zou, Yu
    Yang, Jin
    Chao, Jiangang
    Xiong, Ying
    HUMAN-COMPUTER INTERACTION. RECOGNITION AND INTERACTION TECHNOLOGIES, HCI 2019, PT II, 2019, 11567 : 314 - 331
  • [7] Adaptive sensor fusion labeling framework for hand pose recognition in robot teleoperation
    Qi, Wen
    Liu, Xiaorui
    Zhang, Longbin
    Wu, Lunan
    Zang, Wenchuan
    Su, Hang
    ASSEMBLY AUTOMATION, 2021, 41 (03) : 393 - 400
  • [8] Entertainment Robot Hand Gesture Recognition
    Wang, Yuehai
    Li, Jianfei
    2010 2ND INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS PROCEEDINGS (DBTA), 2010,
  • [9] Embedded Virtual Mouse System by Using Hand Gesture Recognition
    Tsai, Tsung-Han
    Huang, Chih-Chi
    Zhang, Kung-Long
    2015 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2015, : 352 - 353
  • [10] Gesture Recognition based Teleoperation Framework of Robotic Fish
    Mi, Jinpeng
    Sun, Yu
    Wang, Yu
    Deng, Zhen
    Li, Liang
    Zhang, Jianwei
    Xie, Guanming
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2016, : 137 - 142