Static and Dynamic Collision Avoidance for Autonomous Robot Navigation in Diverse Scenarios based on Deep Reinforcement Learning

被引:3
|
作者
Pico, Nabih [1 ,2 ]
Lee, Beomjoon [3 ]
Montero, Estrella [2 ]
Tadese, Meseret [1 ,4 ]
Auh, Eugene [1 ]
Doh, Myeongyun [1 ]
Moon, Hyungpil [1 ]
机构
[1] Sungkyunkwan Univ, Dept Mech Engn, Suwon, South Korea
[2] Escuela Super Politecn Litoral ESPOL, Fac Ingn Elect & Computac, Campus Gustavo Galindo, Guayaquil 09015863, Ecuador
[3] Sogang Univ, Dept Elect Engn, 35 Baekbeom Ro, Seoul 04107, South Korea
[4] Addis Ababa Univ, Addis Ababa Inst Technol, Sch Elect & Comp Engn, POB 385, Addis Ababa, Ethiopia
关键词
D O I
10.1109/UR57808.2023.10202431
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This paper proposes an efficient robot training method to navigate environments with static and dynamic obstacles and reach their goal autonomously using deep reinforcement learning algorithms. Previous methods have focused on specific scenarios, such as crowded environments. However, in practice, the variety of scenarios with static and dynamic obstacles tends to make the real robotic system fail or be restricted. In this work, the training is performed in six scenarios per episode, whereas traditional methods only consider one scenario. Several neural networks are trained and compared based on the following metrics: success rate, collision rate, uncomfortable rate, travel time, and average travel distance. In addition, we conducted Gazebo simulations using ROS and experimental tests across four scenarios to demonstrate that our approach has a better performance compared to previous studies. The results show a greatly enhanced robot's ability to act in various situations, as shown in the following link: https://youtu.be/mvkMFZjlaQo
引用
收藏
页码:281 / 286
页数:6
相关论文
共 50 条
  • [31] Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning
    Yao, Shunyi
    Chen, Guangda
    Qiu, Quecheng
    Ma, Jun
    Chen, Xiaoping
    Ji, Jianmin
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 8144 - 8150
  • [32] Mobile Robot Navigation based on Deep Reinforcement Learning
    Ruan, Xiaogang
    Ren, Dingqi
    Zhu, Xiaoqing
    Huang, Jing
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 6174 - 6178
  • [33] Autonomous Obstacle Avoidance with Improved Deep Reinforcement Learning Based on Dynamic Huber Loss
    Xu, Xiaoming
    Li, Xian
    Chen, Na
    Zhao, Dongjie
    Chen, Chunmei
    APPLIED SCIENCES-BASEL, 2025, 15 (05):
  • [34] TOWARDS THE DEEP LEARNING-BASED AUTONOMOUS COLLISION AVOIDANCE
    He, Binxin
    Xiao, Youan
    Wang, Tengfei
    Li, Zhuo
    PROCEEDINGS OF ASME 2022 INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, IMECE2022, VOL 9, 2022,
  • [35] An Aircraft Collision Avoidance Method Based on Deep Reinforcement Learning
    Liu, Zuocheng
    Neretin, Evgeny
    Gao, Xiaoguang
    Wan, Kaifang
    2024 9TH INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTICS ENGINEERING, ICCRE 2024, 2024, : 241 - 246
  • [36] Autonomous Quantum Reinforcement Learning for Robot Navigation
    Mohan, Arjun
    Jayabalan, Sudharsan
    Mohan, Archana
    PROCEEDINGS OF 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND APPLICATIONS, 2017, 467 : 351 - 357
  • [37] Autonomous Mobile Robot with Simple Navigation System Based on Deep Reinforcement Learning and a Monocular Camera
    Yokoyama, Koki
    Morioka, Kazuyuki
    2020 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2020, : 525 - 530
  • [38] Vision-Based Autonomous Navigation Approach for a Tracked Robot Using Deep Reinforcement Learning
    Ejaz, Muhammad Mudassir
    Tang, Tong Boon
    Lu, Cheng-Kai
    IEEE SENSORS JOURNAL, 2021, 21 (02) : 2230 - 2240
  • [39] Obstacle Avoidance Algorithm for Mobile Robot Based on Deep Reinforcement Learning in Dynamic Environments
    Sun Xiaoxian
    Yao Chenpeng
    Zhou Haoran
    Liu Chengju
    Chen Qijun
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 366 - 372
  • [40] Air Learning: a deep reinforcement learning gym for autonomous aerial robot visual navigation
    Srivatsan Krishnan
    Behzad Boroujerdian
    William Fu
    Aleksandra Faust
    Vijay Janapa Reddi
    Machine Learning, 2021, 110 : 2501 - 2540