Narrow-Route Path Planning for Mobile Robots Using Deep Deterministic Policy Gradient Considering Turning Radius Limit

被引:1
|
作者
Motoi, Naoki [1 ]
Nakamura, Tomoaki [1 ]
机构
[1] Kobe Univ, Grad Sch Maritime Sci, Kobe 6580022, Japan
来源
IEEE ACCESS | 2024年 / 12卷
基金
日本学术振兴会;
关键词
Turning; Mobile robots; Path planning; Roads; Robot kinematics; Wheels; Robot sensing systems; Collision avoidance; Robustness; Real-time systems; Motion control; path planning; reinforcement learning; mobile robot; COLLISION-AVOIDANCE; ENVIRONMENTS; ALGORITHM; LOCALIZATION;
D O I
10.1109/ACCESS.2024.3501321
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a narrow-route path planning for a mobile robot using deep deterministic policy gradient (DDPG) considering a drive system. In this paper, a narrow road is defined as a space in which a mobile robot with a non-holonomic constraint cannot move without performing turnabouts. There are various drive systems for mobile robots such as an independent two-driven wheels type, a steering type, and a car-like type. In an independent two-driven wheels type, the mobile robot plans the path including on-the-spot turning. On the other hand, in a steering type and a car-like type, the mobile robot performs the turnabouts on a narrow road. In wheeled robots, differences in drive systems can be expressed as a turning radius limit. The proposed method generates narrow-route path planning considering a turning radius limit due to a drive system. The proposed method is based on machine learning and uses DDPG as reinforcement learning. The trained model determines the translational and angular velocities that include turnabouts / on-the-spot turning according to environmental information in real time. In the simulation and experiments, we confirmed that the proposed method allowed a mobile robot, with or without a turning radius limit, to pass through a narrow road. In addition, the robustness against the trained model was evaluated by several narrow roads that differed from the learning environment. In the case of the drive system with the turning radius limit, the success rate of driving on narrow roads including different learning environments was 94% in simulation and 85% in experiments. Therefore, the effectiveness of the proposed method was confirmed by the simulation and experimental results.
引用
收藏
页码:171076 / 171086
页数:11
相关论文
共 39 条
  • [1] Deep Deterministic Policy Gradient for Navigation of Mobile Robots
    de Jesus, Junior Costa
    Bottega, Jair Augusto
    de Souza Leite Cuadros, Marco Antonio
    Tello Gamarra, Daniel Fernando
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (01) : 349 - 361
  • [2] Local Path Planning with Turnabouts for Mobile Robot by Deep Deterministic Policy Gradient
    Nakamura, Tomoaki
    Kobayashi, Masato
    Motoi, Naoki
    2023 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS, ICM, 2023,
  • [3] Efficient Path Planning for Mobile Robot Based on Deep Deterministic Policy Gradient
    Gong, Hui
    Wang, Peng
    Ni, Cui
    Cheng, Nuo
    SENSORS, 2022, 22 (09)
  • [4] Mapless Path Planning for Mobile Robot Based on Improved Deep Deterministic Policy Gradient Algorithm
    Zhang, Shuzhen
    Tang, Wei
    Li, Panpan
    Zha, Fusheng
    SENSORS, 2024, 24 (17)
  • [5] Deep Deterministic Policy Gradient for Navigation of Mobile Robots in Simulated Environments
    Jesus, Junior C.
    Bottega, Jair A.
    Cuadros, Marco A. S. L.
    Gamarra, Daniel F. T.
    2019 19TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2019, : 362 - 367
  • [6] Mobile robot path planning using deep deterministic policy gradient with differential gaming (DDPG-DG) exploration
    Deshpande, Shripad V.
    R, Harikrishnan
    Ibrahim, Babul Salam KSM Kader
    Ponnuru, Mahesh Datta Sai
    Cognitive Robotics, 2024, 4 : 156 - 173
  • [7] Path Planning of Humanoid Arm Based on Deep Deterministic Policy Gradient
    Wen, Shuhuan
    Chen, Jianhua
    Wang, Shen
    Zhang, Hong
    Hu, Xueheng
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 1755 - 1760
  • [8] Path planning based on improved Deep Deterministic Policy Gradient algorithm
    Liu, Yandong
    Zhang, Wenzhi
    Chen, Fumin
    Li, Jianliang
    PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 295 - 299
  • [9] Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient
    Chen, Jinlong
    Jiang, Yun
    Pan, Hongren
    Yang, Minghao
    ELECTRONICS, 2024, 13 (18)
  • [10] Deep deterministic policy gradient algorithm for crowd-evacuation path planning
    Li, Xinjin
    Liu, Hong
    Li, Junqing
    Li, Yan
    COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 161