Deep Deterministic Policy Gradient for Navigation of Mobile Robots

被引:10
|
作者
de Jesus, Junior Costa [1 ]
Bottega, Jair Augusto [2 ]
de Souza Leite Cuadros, Marco Antonio [3 ]
Tello Gamarra, Daniel Fernando [4 ]
机构
[1] Fed Univ Rio Grande, Rio Grande, RS, Brazil
[2] Univ Fed Santa Maria, Santa Maria, RS, Brazil
[3] Fed Inst Espirito Santo, Serra, ES, Brazil
[4] Univ Fed Santa Maria, Proc Dept Elect, Santa Maria, RS, Brazil
关键词
Deep Deterministic Policy Gradient; Deep Reinforcement Learning; Navigation for Mobile Robots;
D O I
10.3233/JIFS-191711
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article describes the use of the Deep Deterministic Policy Gradient network, a deep reinforcement learning algorithm, for mobile robot navigation. The neural network structure has as inputs laser range findings, angular and linear velocities of the robot, and position and orientation of the mobile robot with respect to a goal position. The outputs of the network will be the angular and linear velocities used as control signals for the robot. The experiments demonstrated that deep reinforcement learning's techniques that uses continuous actions, are efficient for decision-making in a mobile robot. Nevertheless, the design of the reward functions constitutes an important issue in the performance of deep reinforcement learning algorithms. In order to show the performance of the Deep Reinforcement Learning algorithm, we have applied successfully the proposed architecture in simulated environments and in experiments with a real robot.
引用
收藏
页码:349 / 361
页数:13
相关论文
共 50 条
  • [1] Deep Deterministic Policy Gradient for Navigation of Mobile Robots in Simulated Environments
    Jesus, Junior C.
    Bottega, Jair A.
    Cuadros, Marco A. S. L.
    Gamarra, Daniel F. T.
    2019 19TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2019, : 362 - 367
  • [2] Deep Deterministic Policy Gradient-Based Autonomous Driving for Mobile Robots in Sparse Reward Environments
    Park, Minjae
    Lee, Seok Young
    Hong, Jin Seok
    Kwon, Nam Kyu
    SENSORS, 2022, 22 (24)
  • [3] Failure Prevention in Bimanual Robots using Deep Deterministic Policy Gradient
    Menekse, Asel
    Ak, Abdullah Cihan
    Sariel, Sanem
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [4] Deep deterministic policy gradient with constraints for gait optimisation of biped robots
    Liu, Xingyang
    Rong, Haina
    Neri, Ferrante
    Yue, Peng
    Zhang, Gexiang
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2024, 31 (02) : 139 - 156
  • [5] Robot arm navigation using deep deterministic policy gradient algorithms
    Farag, Wael
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2023, 35 (05) : 617 - 627
  • [6] Local Path Planning with Turnabouts for Mobile Robot by Deep Deterministic Policy Gradient
    Nakamura, Tomoaki
    Kobayashi, Masato
    Motoi, Naoki
    2023 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS, ICM, 2023,
  • [7] Narrow-Route Path Planning for Mobile Robots Using Deep Deterministic Policy Gradient Considering Turning Radius Limit
    Motoi, Naoki
    Nakamura, Tomoaki
    IEEE ACCESS, 2024, 12 : 171076 - 171086
  • [8] Efficient Path Planning for Mobile Robot Based on Deep Deterministic Policy Gradient
    Gong, Hui
    Wang, Peng
    Ni, Cui
    Cheng, Nuo
    SENSORS, 2022, 22 (09)
  • [9] Reinforcement Learning for Mobile Robot Obstacle Avoidance with Deep Deterministic Policy Gradient
    Chen, Miao
    Li, Wenna
    Fei, Shihan
    Wei, Yufei
    Tu, Mingyang
    Li, Jiangbo
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT III, 2022, 13457 : 197 - 204
  • [10] Improved Deep Deterministic Policy Gradient for Dynamic Obstacle Avoidance of Mobile Robot
    Gao, Xiaoshan
    Yan, Liang
    Li, Zhijun
    Wang, Gang
    Chen, I-Ming
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (06): : 3675 - 3682