Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

被引:15
|
作者
Yang, Laiyi [1 ]
Bi, Jing [1 ]
Yuan, Haitao [2 ]
机构
[1] Beijing Univ Technol, Sch Software Engn, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
来源
IFAC PAPERSONLINE | 2022年 / 55卷 / 11期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; path planning; Soft Actor-Critic algorithm; continuous reward functions; mobile robots; ALGORITHM;
D O I
10.1016/j.ifacol.2022.08.042
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional path planning algorithms for mobile robots are not effective to solve high-dimensional problems, and suffer from slow convergence and complex modelling. Therefore, it is highly essential to design a more efficient algorithm to realize intelligent path planning of mobile robots. This work proposes an improved path planning algorithm, which is based on the algorithm of Soft Actor-Critic (SAC). It attempts to solve a problem of poor robot performance in complicated environments with static and dynamic obstacles. This work designs an improved reward function to enable mobile robots to quickly avoid obstacles and reach targets by using state dynamic normalization and priority replay buffer techniques. To evaluate its performance, a Pygame-based simulation environment is constructed. The proposed method is compared with a Proximal Policy Optimization (PPO) algorithm in the simulation environment. Experimental results demonstrate that the cumulative reward of the proposed method is much higher than that of PPO, and it is also more robust than PPO. Copyright (C) 2022 The Authors.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 50 条
  • [21] Hierarchical Control Framework for Path Planning of Mobile Robots in Dynamic Environments Through Global Guidance and Reinforcement Learning
    Zhao, Hongyang
    Guo, Yanan
    Li, Xingdong
    Liu, Yi
    Jin, Jing
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (01): : 309 - 333
  • [22] Dynamic path planning for autonomous mobile robots
    Yoon, Hee-Sang
    You, Jin-Oh
    Park, Tae-Hyoung
    Journal of Institute of Control, Robotics and Systems, 2008, 14 (04) : 392 - 398
  • [23] Continuous Motion Planning for Mobile Robots Using Fuzzy Deep Reinforcement Learning
    Wu, Fenghua
    Tang, Wenbing
    Zhou, Yuan
    Lin, Shang-Wei
    Liu, Yang
    Ding, Zuohua
    2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, : 15 - 21
  • [24] Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning
    Tang, Jin
    Liang, Yangang
    Li, Kebo
    DRONES, 2024, 8 (02)
  • [25] Deep Reinforcement Learning With Dynamic Graphs for Adaptive Informative Path Planning
    Vashisth, Apoorva
    Rueckin, Julius
    Magistri, Federico
    Stachniss, Cyrill
    Popovic, Marija
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (09): : 7747 - 7754
  • [26] Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning
    Lei, Xiaoyun
    Zhang, Zhian
    Dong, Peifang
    JOURNAL OF ROBOTICS, 2018, 2018
  • [27] Dynamic Programming Field Based Environment Learning and Path Planning for Mobile Robots
    Yuan, Yuan
    Cao, Zhiqiang
    Hou, Zengguang
    Tan, Min
    2010 8TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2010, : 883 - 887
  • [28] Path Planning for Mobile Robot Based on Deep Reinforcement Learning and Fuzzy Control
    Liu, Chunling
    Xu, Jun
    Guo, Kaiwen
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 533 - 537
  • [29] Target Tracking and Path Planning of Mobile Sensor Based on Deep Reinforcement Learning
    Zhang, Kun
    Hu, Yuanjiang
    Huang, Deqing
    Yin, Zijie
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 190 - 195
  • [30] Path Planning Method of Mobile Robot Using Improved Deep Reinforcement Learning
    Wang, Wei
    Wu, Zhenkui
    Luo, Huafu
    Zhang, Bin
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2022, 2022