Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

被引:15
|
作者
Yang, Laiyi [1 ]
Bi, Jing [1 ]
Yuan, Haitao [2 ]
机构
[1] Beijing Univ Technol, Sch Software Engn, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
来源
IFAC PAPERSONLINE | 2022年 / 55卷 / 11期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; path planning; Soft Actor-Critic algorithm; continuous reward functions; mobile robots; ALGORITHM;
D O I
10.1016/j.ifacol.2022.08.042
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional path planning algorithms for mobile robots are not effective to solve high-dimensional problems, and suffer from slow convergence and complex modelling. Therefore, it is highly essential to design a more efficient algorithm to realize intelligent path planning of mobile robots. This work proposes an improved path planning algorithm, which is based on the algorithm of Soft Actor-Critic (SAC). It attempts to solve a problem of poor robot performance in complicated environments with static and dynamic obstacles. This work designs an improved reward function to enable mobile robots to quickly avoid obstacles and reach targets by using state dynamic normalization and priority replay buffer techniques. To evaluate its performance, a Pygame-based simulation environment is constructed. The proposed method is compared with a Proximal Policy Optimization (PPO) algorithm in the simulation environment. Experimental results demonstrate that the cumulative reward of the proposed method is much higher than that of PPO, and it is also more robust than PPO. Copyright (C) 2022 The Authors.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-Based Path Planning with Dynamic Collision Probability for Mobile Robots
    Tariq, Muhammad Taha
    Wang, Congqing
    Hussain, Yasir
    2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, : 9 - 14
  • [2] Deep reinforcement learning for motion planning of mobile robots
    Sun H.-H.
    Hu C.-H.
    Zhang J.-G.
    Kongzhi yu Juece/Control and Decision, 2021, 36 (06): : 1281 - 1292
  • [3] Path Planning for Mobile Robots Using Transfer Reinforcement Learning
    Zheng, Xinwang
    Zheng, Wenjie
    Du, Yong
    Li, Tiejun
    Yuan, Zhansheng
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2024, 33 (07)
  • [4] A dynamic fusion path planning algorithm for mobile robots incorporating improved IB-RRT∗ and deep reinforcement learning
    Liu A.
    Zhang B.
    Cui Q.
    Zhang D.
    Ni H.
    High Technology Letters, 2023, 29 (04) : 365 - 376
  • [5] A dynamic fusion path planning algorithm for mobile robots incorporating improved IB-RRT* and deep reinforcement learning
    刘安东
    ZHANG Baixin
    CUI Qi
    ZHANG Dan
    NI Hongjie
    High Technology Letters, 2023, 29 (04) : 365 - 376
  • [6] Path Following for Autonomous Mobile Robots with Deep Reinforcement Learning
    Cao, Yu
    Ni, Kan
    Kawaguchi, Takahiro
    Hashimoto, Seiji
    SENSORS, 2024, 24 (02)
  • [7] Path planning for mobile robots using an improved reinforcement learning scheme
    Fujisawa, S
    Kurozumi, R
    Yamamoto, T
    Suita, Y
    PROCEEDINGS OF THE 2002 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL, 2002, : 67 - 74
  • [8] Path planning for mobile robots using an improved reinforcement learning scheme
    Kurozumi, R
    Fujisawa, S
    Yamamoto, T
    Suita, Y
    SICE 2002: PROCEEDINGS OF THE 41ST SICE ANNUAL CONFERENCE, VOLS 1-5, 2002, : 2178 - 2183
  • [9] Dynamic Path Planning for Mobile Robots with Cellular Learning Automata
    Santoso, Judhi
    Riyanto, Bambang
    Adiprawita, Widyawardhana
    JOURNAL OF ICT RESEARCH AND APPLICATIONS, 2016, 10 (01) : 1 - 14
  • [10] Deep reinforcement learning for indoor mobile robot path planning
    Gao, Junli
    Ye, Weijie
    Guo, Jing
    Li, Zhongjuan
    Sensors (Switzerland), 2020, 20 (19): : 1 - 15