Remotely controlling of mobile robots using gesture captured by the Kinect and recognized by machine learning method

被引：0

作者：

Hsu, Roy Chaoming ^{[1
]}

Jian, Jhih-Wei ^{[2
]}

Lin, Chih-Chuan ^{[2
]}

Lai, Chien-Hung ^{[2
]}

Liu, Cheng-Ting ^{[2
]}

机构：

[1] Dept Elect Engn, 300 Syuefu Rd, Chiayi 60004, Taiwan

[2] Dept Comp Sci Informat Engn, Chiayi 60004, Taiwan

来源：

INTELLIGENT ROBOTS AND COMPUTER VISION XXX: ALGORITHMS AND TECHNIQUES | 2013年 / 8662卷

关键词：

Robot remote control; Kinect sensor; gesture recognition; back propagation neural network;

D O I：

10.1117/12.2008456

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

The main purpose of this paper is to use machine learning method and Kinect and its body sensation technology to design a simple, convenient, yet effective robot remote control system. In this study, a Kinect sensor is used to capture the human body skeleton with depth information, and a gesture training and identification method is designed using the back propagation neural network to remotely command a mobile robot for certain actions via the Bluetooth. The experimental results show that the designed mobile robots remote control system can achieve, on an average, more than 96% of accurate identification of 7 types of gestures and can effectively control a real e-puck robot for the designed commands.

引用

页数：9

共 50 条

[1] Remote control for mobile robots using gestures captured by the RGB camera and recognized by deep learning techniques
Martinelli, Dieisson
de Sousa, Alex Luiz
Augusto, Mario Ezequiel
Kalempa, Vivian Cremer
de Oliveira, Andre Schneider
Rohrich, Ronnier Frates
Simoes Teixeira, Marco Antonio
2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), 2019, : 98 - 103
[2] Gesture Classification with Machine Learning using Kinect Sensor Data
Bhattacharya, Sambit
Czejdo, Bogdan
Perez, Nicolas
2012 THIRD INTERNATIONAL CONFERENCE ON EMERGING APPLICATIONS OF INFORMATION TECHNOLOGY (EAIT), 2012, : 348 - 351
[3] Mobility characterization for autonomous mobile robots using machine learning
Eric Trautmann
Laura Ray
Autonomous Robots, 2011, 30 : 369 - 383
[4] Mobility characterization for autonomous mobile robots using machine learning
Trautmann, Eric
Ray, Laura
AUTONOMOUS ROBOTS, 2011, 30 (04) : 369 - 383
[5] Kinect Gesture Recognition Method Using Track Sequence
Wang, Ying
Liu, Zheng-dong
INTERNATIONAL CONFERENCE ON COMPUTER, MECHATRONICS AND ELECTRONIC ENGINEERING (CMEE 2016), 2016,
[6] Users Activity Gesture Recognition on Kinect Sensor Using Convolutional Neural Networks and FastDTW for Controlling Movements of a Mobile Robot
Pfitscher, Miguel
Welfer, Daniel
do Nascimento, Evaristo Jose
de Souza Leite Cuadros, Marco Antonio
Tello Gamarra, Daniel Fernando
INTELIGENCIA ARTIFICIAL-IBEROAMERICAL JOURNAL OF ARTIFICIAL INTELLIGENCE, 2019, 22 (63): : 121 - 134
[7] Users activity gesture recognition on kinect sensor using convolutional neural networks and fastDTW for controlling movements of a mobile robot
Pfitscher M.
Welfer D.
do Nascimento E.J.
Cuadros M.A.S.L.
Gamarra D.F.T.
Inteligencia Artificial, 2019, 22 (63) : 121 - 134
[8] Gesture and Voice Driven Mobile Tribot Robot Using Kinect Sensor
Baron, G.
Czekalski, P.
Golenia, M.
Tokarz, K.
2013 INTERNATIONAL SYMPOSIUM ON ELECTRODYNAMIC AND MECHATRONIC SYSTEM (SELM 2013), 2013, : 33 - 34
[9] Efficient Traversability Analysis for Mobile Robots using the Kinect Sensor
Bogoslavskyi, Igor
Vysotska, Olga
Serafin, Jacopo
Grisetti, Giorgio
Stachniss, Cyrill
2013 EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR 2013), 2013, : 158 - 163
[10] Hand Gesture Recognition Using Kinect via Deterministic Learning
Liu, Fenglin
Du, Bangxing
Wang, Qinghui
Wang, Ying
Zeng, Wei
2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 2127 - 2132

← 1 2 3 4 5 →