Static and Dynamic Collision Avoidance for Autonomous Robot Navigation in Diverse Scenarios based on Deep Reinforcement Learning

被引:3
|
作者
Pico, Nabih [1 ,2 ]
Lee, Beomjoon [3 ]
Montero, Estrella [2 ]
Tadese, Meseret [1 ,4 ]
Auh, Eugene [1 ]
Doh, Myeongyun [1 ]
Moon, Hyungpil [1 ]
机构
[1] Sungkyunkwan Univ, Dept Mech Engn, Suwon, South Korea
[2] Escuela Super Politecn Litoral ESPOL, Fac Ingn Elect & Computac, Campus Gustavo Galindo, Guayaquil 09015863, Ecuador
[3] Sogang Univ, Dept Elect Engn, 35 Baekbeom Ro, Seoul 04107, South Korea
[4] Addis Ababa Univ, Addis Ababa Inst Technol, Sch Elect & Comp Engn, POB 385, Addis Ababa, Ethiopia
关键词
D O I
10.1109/UR57808.2023.10202431
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This paper proposes an efficient robot training method to navigate environments with static and dynamic obstacles and reach their goal autonomously using deep reinforcement learning algorithms. Previous methods have focused on specific scenarios, such as crowded environments. However, in practice, the variety of scenarios with static and dynamic obstacles tends to make the real robotic system fail or be restricted. In this work, the training is performed in six scenarios per episode, whereas traditional methods only consider one scenario. Several neural networks are trained and compared based on the following metrics: success rate, collision rate, uncomfortable rate, travel time, and average travel distance. In addition, we conducted Gazebo simulations using ROS and experimental tests across four scenarios to demonstrate that our approach has a better performance compared to previous studies. The results show a greatly enhanced robot's ability to act in various situations, as shown in the following link: https://youtu.be/mvkMFZjlaQo
引用
收藏
页码:281 / 286
页数:6
相关论文
共 50 条
  • [21] An Intelligent Algorithm for USVs Collision Avoidance Based on Deep Reinforcement Learning Approach with Navigation Characteristics
    Sun, Zhe
    Fan, Yunsheng
    Wang, Guofeng
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (04)
  • [22] Self-Learning Robot Autonomous Navigation with Deep Reinforcement Learning Techniques
    Pintos Gomez de las Heras, Borja
    Martinez-Tomas, Rafael
    Cuadra Troncoso, Jose Manuel
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [23] CONTROL METHOD FOR PATH FOLLOWING AND COLLISION AVOIDANCE OF AUTONOMOUS SHIP BASED ON DEEP REINFORCEMENT LEARNING
    Zhao, Luman
    Roh, Myung-Il
    Lee, Sung-Jun
    JOURNAL OF MARINE SCIENCE AND TECHNOLOGY-TAIWAN, 2019, 27 (04): : 293 - 310
  • [24] Experimental Research on Deep Reinforcement Learning in Autonomous navigation of Mobile Robot
    Yue, Pengyu
    Xin, Jing
    Zhao, Huan
    Liu, Ding
    Shan, Mao
    Zhang, Jian
    PROCEEDINGS OF THE 2019 14TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2019), 2019, : 1612 - 1616
  • [25] Enhancing Efficiency in Collision Avoidance: A Study on Transfer Reinforcement Learning in Autonomous Ships' Navigation
    Wang, Xinrui
    Jin, Yan
    ASME OPEN JOURNAL OF ENGINEERING, 2024, 3
  • [26] Deep reinforcement learning with predictive auxiliary task for autonomous train collision avoidance
    Plissonneau, Antoine
    Jourdan, Luca
    Trentesaux, Damien
    Abdi, Lotfi
    Sallak, Mohamed
    Bekrar, Abdelghani
    Quost, Benjamin
    Schoen, Walter
    JOURNAL OF RAIL TRANSPORT PLANNING & MANAGEMENT, 2024, 31
  • [27] Autonomous Robot Navigation with Self-learning for Collision Avoidance with Randomly Moving Obstacles
    Zhang, Yunfei
    de Silva, Clarence W.
    Su, Dijia
    Xue, Youtai
    2014 PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION (ICCSE 2014), 2014, : 117 - 122
  • [28] The autonomous navigation and obstacle avoidance for USVs with ANOA deep reinforcement learning method
    Wu, Xing
    Chen, Haolei
    Chen, Changgu
    Zhong, Mingyu
    Xie, Shaorong
    Guo, Yike
    Fujita, Hamido
    KNOWLEDGE-BASED SYSTEMS, 2020, 196 (196)
  • [29] Learning-Based Navigation and Collision Avoidance Through Reinforcement for UAVs
    Azzam, Rana
    Chehadeh, Mohamad
    Hay, Oussama Abdul
    Humais, Muhammad Ahmed
    Boiko, Igor
    Zweiri, Yahya
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (03) : 2614 - 2628
  • [30] Growing Robot Navigation Based on Deep Reinforcement Learning
    Ataka, Ahmad
    Sandiwan, Andreas P.
    2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 115 - 120