A quadrotor controlled in real-time using hand gestures and ROS2 multi-node communication within GAZEBO 3D environment

被引:0
|
作者
Djizi, Hamza [1 ]
Lakehal, Abdelaziz [2 ]
Zahzouh, Zoubir [2 ]
机构
[1] Univ Souk Ahras, Dept Mech Engn, INFRA RES Lab, POB 1553, Souk Ahras 41000, Algeria
[2] Univ Souk Ahras, Lab Res Electromech & Dependabil, POB 1553, Souk Ahras 41000, Algeria
关键词
Robotic Operating System 2; ROS2; quadrotor; GAZEBO; control; communication; hand gestures; TRACKING CONTROL; DESIGN; QUADCOPTER; UAV;
D O I
10.1504/IJAAC.2024.137069
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces a novel way of designing and controlling a quadrotor prototype using hand gestures, utilising the Robotic Operating System 2 (ROS2) and GAZEBO11 3D environment. A C++-based plug-in was created for GAZEBO, while the cross-platform pipeline framework Media-Pipe was used to manage the quadrotor's movements through hand gestures. The PID regulator was utilised to enhance the movements' accuracy and responsiveness, leading to a more efficient and precise response to user commands for a better user experience. The obtained results demonstrated that the PID regulator improved the response of the quadrotor to hand gestures with greater accuracy.
引用
收藏
页码:214 / 231
页数:19
相关论文
共 50 条
  • [1] Real-Time 3D Hand Gestures Recognition for Manipulation of Industrial Robots
    Cerlinca, T.
    Pentiuc, S. G.
    Vlad, V.
    ELEKTRONIKA IR ELEKTROTECHNIKA, 2013, 19 (02) : 3 - 8
  • [2] Real-time 3D hand tracking in a virtual environment
    Smith, KC
    Sandin, D
    Huang, TS
    Eliason, JJ
    Baum, GA
    STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS X, 2003, 5006 : 529 - 543
  • [3] Real-time Detection and Interpretation of 3D Deictic Gestures for Interaction With an Intelligent Environment
    Richarz, Jan
    Ploetz, Thomas
    Fink, Gernot A.
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 1470 - 1473
  • [4] Real-time input of 3D pose and gestures of a user's hand and its applications for HCI
    Sato, Y
    Saito, M
    Koike, H
    IEEE VIRTUAL REALITY 2001, PROCEEDINGS, 2001, : 79 - 86
  • [5] Development of Real-Time Electromyography Controlled 3D Printed Robot Hand Prototype
    Wahit, Mohamad Aizat Abdul
    Romzi, Fatimahtul Zahrah
    Ahmad, Siti Anom
    Marhaban, Mohd Hamiruce
    Chikamune, Wada
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2019, 10 (01) : 35 - 44
  • [6] Real-time 3D Recognition of Manipulated Object by Robot Hand Using 3D Sensor
    Minowa, Ryo
    Namiki, Akio
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1798 - 1803
  • [7] Real-time 3D Hand Posture Reconstruction using Stereo Vision
    Mogol, Ali Can
    Hassanpour, Reza
    Oztoprak, Kasim
    2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1926 - 1932
  • [8] Real-time Rotation Invariant Hand Tracking Using 3D Data
    Abu Bakar, M. Zabri
    Samad, Rosdiyana
    Pebrianti, Dwi
    Aan, Nicolaas Lim Yong
    2014 IEEE INTERNATIONAL CONFERENCE ON CONTROL SYSTEM COMPUTING AND ENGINEERING, 2014, : 490 - 495
  • [9] Autonomous and 3D real-time multi-beam manipulation in a microfluidic environment
    Perch-Nielsen, Ivan R.
    Rodrigo, Peter John
    Alonzo, Carlo Amadeo
    Gluckstad, Jesper
    OPTICS EXPRESS, 2006, 14 (25): : 12199 - 12205
  • [10] A Synchronized Multi-view System for Real-Time 3D Hand Pose Estimation
    Yu, Zhipeng
    Wang, Yangang
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT III, 2022, 13606 : 588 - 593