A Behavior-Based Mobile Robot Navigation Method with Deep Reinforcement Learning

被引:19
|
作者
Li, Juncheng [1 ]
Ran, Maopeng [1 ]
Wang, Han [1 ]
Xie, Lihua [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
关键词
Autonomous navigation; mobile robots; deep reinforcement learning;
D O I
10.1142/S2301385021410041
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep reinforcement learning-based mobile robot navigation has attracted some recent interest. In the single-agent case, a robot can learn to navigate autonomously without a map of the environment. In the multi-agent case, robots can learn to avoid collisions with each other. In this work, we propose a behavior-based mobile robot navigation method which directly maps the raw sensor data and goal information to the control command. The learned navigation policy can be applied in both single-agent and multi-agent scenarios. Two basic navigation behaviors are considered in our method, which are goal reaching and collision avoidance. The two behaviors are fused based on the risk-level estimation of the current state. The navigation task is decomposed using the behavior-based framework, which is capable of reducing the complexity of the learning process. The simulations and real-world experiments demonstrate that the proposed method can enable the collision-free autonomous navigation of multiple mobile robots in unknown environments.
引用
收藏
页码:201 / 209
页数:9
相关论文
共 50 条
  • [41] Mapless navigation based on deep reinforcement learning for mobile robots
    Hu G.-M.
    Cai K.-W.
    Wang F.
    Kang Y.-W.
    Zhang J.-X.
    Jin Z.
    Lin Y.-S.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (03): : 985 - 993
  • [42] An architecture for behavior-based reinforcement learning
    Konidaris, GD
    Hayes, GM
    ADAPTIVE BEHAVIOR, 2005, 13 (01) : 5 - 32
  • [43] Implementation of Behavior-Based Navigation Algorithm on Four-Wheel Steering Mobile Robot
    Saeedi, Behzad
    Sadedel, Majid
    JOURNAL OF COMPUTATIONAL APPLIED MECHANICS, 2021, 52 (04): : 616 - 636
  • [44] Research on Target-Driven Navigation of Mobile Robot Based on Deep Reinforcement Learning and Preprocessing Layer
    Yu, Gang
    Zhang, Chang
    Xu, Jiexiong
    Sun, Tongda
    5TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2020), 2020, 1575
  • [45] Deep Reinforcement Learning-Based Mapless Navigation for Mobile Robot in Unknown Environment With Local Optima
    Hu, Yiming
    Wang, Shuting
    Xie, Yuanlong
    Zheng, Shiqi
    Shi, Peng
    Rudas, Imre
    Cheng, Xiang
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 628 - 635
  • [46] A robust method for mobile robot tracking object on behavior-based robotics
    Meng, Yan
    Liu, Xiyu
    Liang, Zhen
    PROCEEDINGS OF THE 2007 1ST INTERNATIONAL SYMPOSIUM ON INFORMATION TECHNOLOGIES AND APPLICATIONS IN EDUCATION (ISITAE 2007), 2007, : 468 - +
  • [47] A Deep Reinforcement Learning Method for Mobile Robot Collision Avoidance based on Double DQN
    Xue, Xidi
    Li, Zhan
    Zhang, Dongsheng
    Yan, Yingxin
    2019 IEEE 28TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2019, : 2131 - 2136
  • [48] Tracking control for mobile robot based on deep reinforcement learning
    Zhang Shansi
    Wang Weiming
    2019 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2019), 2019, : 155 - 160
  • [49] Predictive reinforcement learning: map-less navigation method for mobile robot
    Dobriborsci, Dmitrii
    Zashchitin, Roman
    Kakanov, Mikhail
    Aumer, Wolfgang
    Osinenko, Pavel
    JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 35 (8) : 4217 - 4232
  • [50] Intellectual Method of guiding Mobile Robot Navigation using Reinforcement Learning Algorithm
    Nirmala, G.
    Geetha, S.
    Selvakumar, S.
    2015 IEEE INTERNATIONAL CONFERENCE ON ENGINEERING AND TECHNOLOGY (ICETECH), 2015, : 189 - 192