Deep Deterministic Policy Gradient for Navigation of Mobile Robots

被引:10
|
作者
de Jesus, Junior Costa [1 ]
Bottega, Jair Augusto [2 ]
de Souza Leite Cuadros, Marco Antonio [3 ]
Tello Gamarra, Daniel Fernando [4 ]
机构
[1] Fed Univ Rio Grande, Rio Grande, RS, Brazil
[2] Univ Fed Santa Maria, Santa Maria, RS, Brazil
[3] Fed Inst Espirito Santo, Serra, ES, Brazil
[4] Univ Fed Santa Maria, Proc Dept Elect, Santa Maria, RS, Brazil
关键词
Deep Deterministic Policy Gradient; Deep Reinforcement Learning; Navigation for Mobile Robots;
D O I
10.3233/JIFS-191711
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article describes the use of the Deep Deterministic Policy Gradient network, a deep reinforcement learning algorithm, for mobile robot navigation. The neural network structure has as inputs laser range findings, angular and linear velocities of the robot, and position and orientation of the mobile robot with respect to a goal position. The outputs of the network will be the angular and linear velocities used as control signals for the robot. The experiments demonstrated that deep reinforcement learning's techniques that uses continuous actions, are efficient for decision-making in a mobile robot. Nevertheless, the design of the reward functions constitutes an important issue in the performance of deep reinforcement learning algorithms. In order to show the performance of the Deep Reinforcement Learning algorithm, we have applied successfully the proposed architecture in simulated environments and in experiments with a real robot.
引用
收藏
页码:349 / 361
页数:13
相关论文
共 50 条
  • [31] Adaptive Deep Ant Colony Optimization-Asymmetric Strategy Network Twin Delayed Deep Deterministic Policy Gradient Algorithm: Path Planning for Mobile Robots in Dynamic Environments
    Li, Xiangcheng
    Ruan, Zhaokai
    Ou, Yang
    Ban, Dongri
    Sun, Youming
    Qin, Tuanfa
    Cai, Yiyi
    ELECTRONICS, 2024, 13 (20)
  • [32] Multi-UAV Cooperative Autonomous Navigation Based on Multi-agent Deep Deterministic Policy Gradient
    Li B.
    Yue K.-Q.
    Gan Z.-G.
    Gao P.-X.
    Yuhang Xuebao/Journal of Astronautics, 2021, 42 (06): : 757 - 765
  • [33] Dynamic Multi-Agent Deep Deterministic Policy Gradient for Autonomous Navigation of Reconfigurable Unmanned Aerial Vehicle
    Lu Xin
    Wu Zegui
    Zhao Ruqing
    Li Fusheng
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 10574 - 10580
  • [34] Deep Reinforcement Learning For Visual Navigation of Wheeled Mobile Robots
    Nwaonumah, Ezebuugo
    Samanta, Biswanath
    IEEE SOUTHEASTCON 2020, 2020,
  • [35] Mapless navigation based on deep reinforcement learning for mobile robots
    Hu G.-M.
    Cai K.-W.
    Wang F.
    Kang Y.-W.
    Zhang J.-X.
    Jin Z.
    Lin Y.-S.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (03): : 985 - 993
  • [36] Deterministic chaos in mobile robots
    Da Rold, Federico
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [37] State Representation Learning for Minimax Deep Deterministic Policy Gradient
    Hu, Dapeng
    Jiang, Xuesong
    Wei, Xiumei
    Wang, Jian
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2019, PT I, 2019, 11775 : 481 - 487
  • [38] Deep Deterministic Policy Gradient With Prioritized Sampling for Power Control
    Zhou, Shiyang
    Cheng, Yufan
    Lei, Xia
    Duan, Huanhuan
    IEEE ACCESS, 2020, 8 : 194240 - 194250
  • [39] Controlling Bicycle Using Deep Deterministic Policy Gradient Algorithm
    Le Pham Tuyen
    Chung, TaeChoong
    2017 14TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2017, : 413 - 417
  • [40] Semicentralized Deep Deterministic Policy Gradient in Cooperative StarCraft Games
    Xie, Dong
    Zhong, Xiangnan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (04) : 1584 - 1593