Neural networks based reinforcement learning for mobile robots obstacle avoidance

被引:127
|
作者
Duguleana, Mihai [1 ]
Mogan, Gheorghe [1 ]
机构
[1] Univ Transilvania Brasov, Fac Mech Engn, Dept Automot & Transport Engn, Str Univ 1, Brasov 500036, Romania
关键词
Obstacle avoidance; Neural networks; Q-learning; Virtual reality; MOVING OBSTACLES; NAVIGATION; ENVIRONMENTS;
D O I
10.1016/j.eswa.2016.06.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a new approach for solving the problem of autonomous movement of robots in environments that contain both static and dynamic obstacles. The purpose of this research is to provide mobile robots a collision-free trajectory within an uncertain workspace which contains both stationary and moving entities. The developed solution uses Q-learning and a neural network planner to solve path planning problems. The algorithm presented proves to be effective in navigation scenarios where global information is available. The speed of the robot can be set prior to the computation of the trajectory, which provides a great advantage in time-constrained applications. The solution is deployed in both Virtual Reality (VR) for easier visualization and safer testing activities, and on a real mobile robot for experimental validation. The algorithm is compared with Powerbot's ARNL proprietary navigation algorithm. Results show that the proposed solution has a good conversion rate computed at a satisfying speed. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 115
页数:12
相关论文
共 50 条
  • [21] OBSTACLE AVOIDANCE OF MOBILE ROBOTS BASED ON DYNAMIC WINDOW APPROACH
    Kiss, Domokos
    Tevesz, Gabor
    PROCEEDINGS OF 11TH INTERNATIONAL CARPATHIAN CONTROL CONFERENCE, 2010, 2010, : 75 - 78
  • [22] Image-Based Detection and Obstacle Avoidance for Mobile Robots
    Chen, Cheng-Chuan
    Lu, Ming-Chih
    Chang, Pei-Chun
    Tsai, Cheng-Pei
    PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOTS AND AGENTS, 2009, : 70 - 74
  • [23] Obstacle avoidance for mobile robots using end-to-end learning
    Kim J.-J.
    Koh D.-Y.
    Park J.
    J. Inst. Control Rob. Syst., 2019, 6 (541-545): : 541 - 545
  • [24] Research on Reinforcement Learning of Pedestrian Avoidance Approach for Mobile Robots
    Wang, Weijian
    Wang, Yong
    Yang, Xiao
    Lyu, Zongzhe
    Wu, Zongyi
    Computer Engineering and Applications, 2023, 59 (18) : 316 - 322
  • [25] Obstacle avoidance inverse kinematics solution of redundant robots by neural networks
    Intel Corp, Santa Clara, United States
    Robotica, pt 1 (3-10):
  • [26] Obstacle avoidance inverse kinematics solution of redundant robots by neural networks
    Mao, ZQ
    Hsia, TC
    ROBOTICA, 1997, 15 : 3 - 10
  • [27] A Reinforcement Learning Method of Obstacle Avoidance for Industrial Mobile Vehicles in Unknown Environments Using Neural Network
    Xia, Chen
    El Kamel, A.
    PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT 2014, 2015, : 671 - 675
  • [28] Reinforcement Learning for Mobile Robot Obstacle Avoidance Under Dynamic Environments
    Huang, Liwei
    Qu, Hong
    Fu, Mingsheng
    Deng, Wu
    PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 441 - 453
  • [29] Adaptive navigation of mobile robots with obstacle avoidance
    Fujimori, A
    Nikiforuk, PN
    Gupta, MM
    IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1997, 13 (04): : 596 - 602
  • [30] Formated navigation of mobile robots with obstacle avoidance
    Fujimori, Atsushi
    Saito, Tomoya
    Bohacs, Gabor
    2006 IEEE CONFERENCE ON ROBOTICS, AUTOMATION AND MECHATRONICS, VOLS 1 AND 2, 2006, : 86 - +