Waypoint Navigation of Quadrotor using Deep Reinforcement Learning

被引:1
|
作者
Himanshu, K. Harikumar [1 ]
Pushpangathan, Jinraj, V [1 ]
机构
[1] Int Inst Informat Technol Hyderabad, Hyderabad, India
来源
IFAC PAPERSONLINE | 2022年 / 55卷 / 22期
关键词
Reinforcement learning control; Tracking; Navigation; UAVs; Intelligent robotics;
D O I
10.1016/j.ifacol.2023.03.047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Reinforcement Learning (RL) based technique to develop a simple neural network controller for the task of waypoint navigation in quadrotors. In this paper, the application of Twin Delayed Deep Deterministic (TD3) Policy Gradient algorithm for high and low-level control implementation for quadrotors is discussed. The proposed methods are tested on high fidelity Gym-Pybullet-Drones simulator. The effectiveness of the methods developed is validated through numerical simulations. The simulation results indicate that both control policies are successful in navigating through the assigned waypoint, with the low-level controller being accurate in the nominal flight conditions. In the presence of disturbance inputs, the high-level controller performs better when compared to the low-level controller.
引用
收藏
页码:281 / 286
页数:6
相关论文
共 50 条
  • [21] Autonomous Visual Navigation using Deep Reinforcement Learning: An Overview
    Ejaz, Muhammad Mudassir
    Tang, Tong Boon
    Lu, Cheng-Kai
    2019 17TH IEEE STUDENT CONFERENCE ON RESEARCH AND DEVELOPMENT (SCORED), 2019, : 294 - 299
  • [22] Indoor Navigation with Deep Reinforcement Learning
    Bakale, Vijayalakshmi A.
    Kumar, Yeshwanth V. S.
    Roodagi, Vivekanand C.
    Kulkarni, Yashaswini N.
    Patil, Mahesh S.
    Chickerur, Satyadhyan
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT-2020), 2020, : 660 - 665
  • [23] Socially Aware Robot Navigation Using Deep Reinforcement Learning
    Truong Xuan Tung
    Trung Dung Ngo
    2018 IEEE CANADIAN CONFERENCE ON ELECTRICAL & COMPUTER ENGINEERING (CCECE), 2018,
  • [24] A Deep Reinforcement Learning Approach for Path Following on a Quadrotor
    Rubi, Bartomeu
    Morcego, Bernardo
    Perez, Ramon
    2020 EUROPEAN CONTROL CONFERENCE (ECC 2020), 2020, : 1092 - 1098
  • [25] A fast learning approach for autonomous navigation using a deep reinforcement learning method
    Ejaz, Muhammad Mudassir
    Tang, Tong Boon
    Lu, Cheng-Kai
    ELECTRONICS LETTERS, 2021, 57 (02) : 50 - 53
  • [26] Using Deep Reinforcement Learning with Automatic Curriculum Learning for Mapless Navigation in Intralogistics
    Xue, Honghu
    Hein, Benedikt
    Bakr, Mohamed
    Schildbach, Georg
    Abel, Bengt
    Rueckert, Elmar
    APPLIED SCIENCES-BASEL, 2022, 12 (06):
  • [27] Autonomous UAV Visual Navigation Using an Improved Deep Reinforcement Learning
    Samma, Hussein
    El-Ferik, Sami
    IEEE ACCESS, 2024, 12 : 79967 - 79977
  • [28] Deep Reinforcement Learning for Swarm Navigation Using Different Evolution Strategies
    Diez, Alvaro
    Aznar, Fidel
    2024 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, METAHEURISTICS & SWARM INTELLIGENCE, ISMSI 2024, 2024, : 14 - 19
  • [29] Autonomous UAV Navigation via Deep Reinforcement Learning Using PPO
    Kabas, Bilal
    2022 30TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2022,
  • [30] Visual Navigation for Biped Humanoid Robots Using Deep Reinforcement Learning
    Lobos-Tsunekawa, Kenzo
    Leiva, Francisco
    Ruiz-del-Solar, Javier
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04): : 3247 - 3254