Neural networks based reinforcement learning for mobile robots obstacle avoidance

被引:127
|
作者
Duguleana, Mihai [1 ]
Mogan, Gheorghe [1 ]
机构
[1] Univ Transilvania Brasov, Fac Mech Engn, Dept Automot & Transport Engn, Str Univ 1, Brasov 500036, Romania
关键词
Obstacle avoidance; Neural networks; Q-learning; Virtual reality; MOVING OBSTACLES; NAVIGATION; ENVIRONMENTS;
D O I
10.1016/j.eswa.2016.06.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a new approach for solving the problem of autonomous movement of robots in environments that contain both static and dynamic obstacles. The purpose of this research is to provide mobile robots a collision-free trajectory within an uncertain workspace which contains both stationary and moving entities. The developed solution uses Q-learning and a neural network planner to solve path planning problems. The algorithm presented proves to be effective in navigation scenarios where global information is available. The speed of the robot can be set prior to the computation of the trajectory, which provides a great advantage in time-constrained applications. The solution is deployed in both Virtual Reality (VR) for easier visualization and safer testing activities, and on a real mobile robot for experimental validation. The algorithm is compared with Powerbot's ARNL proprietary navigation algorithm. Results show that the proposed solution has a good conversion rate computed at a satisfying speed. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 115
页数:12
相关论文
共 50 条
  • [31] Iterative Obstacle Avoidance Algorithm for Mobile Robots
    Enrique Sierra-Garcia, J.
    Millan, Marcos
    Santos, Matilde
    16TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING MODELS IN INDUSTRIAL AND ENVIRONMENTAL APPLICATIONS (SOCO 2021), 2022, 1401 : 480 - 488
  • [32] Obstacle avoidance of mobile robots in unknown environments
    Mester, Gyula
    2007 5TH INTERNATIONAL SYMPOSIUM ON INTELLIGENT SYSTEMS & INFORMATICS, 2007, : 107 - 111
  • [33] Neural Control System in Obstacle Avoidance in Mobile Robots Using Ultrasonic Sensors
    Medina-Santiago, A.
    Camas-Anzueto, J. L.
    Vazquez-Feijoo, J. A.
    Hernandez-de Leon, H. R.
    Mota-Grajales, R.
    JOURNAL OF APPLIED RESEARCH AND TECHNOLOGY, 2014, 12 : 104 - 110
  • [34] Obstacle Avoidance and Velocity Control of Mobile Robots
    Mester, Gyula
    2008 6TH INTERNATIONAL SYMPOSIUM ON INTELLIGENT SYSTEMS AND INFORMATICS, 2008, : 97 - 101
  • [35] Object recognition for obstacle avoidance in mobile robots
    Bolanos, Jose M.
    Melendez, Wilfredis Medina
    Fermin, Leonardo
    Cappelletto, Jose
    Fernandez-Lopez, Gerardo
    Grieco, Juan C.
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING - ICAISC 2006, PROCEEDINGS, 2006, 4029 : 722 - 730
  • [36] A method for local obstacle avoidance of mobile robots
    Ko, NY
    Kim, SC
    Cho, HK
    MOBILE ROBOT TECHNOLOGY, PROCEEDINGS, 2001, : 215 - 220
  • [37] Dynamic obstacle avoidance method for mobile robots
    Zhang H.
    Miao C.
    Tang Y.
    Yan X.
    Shi Y.
    Yu Y.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2022, 48 (06): : 1013 - 1021
  • [38] Obstacle avoidance control of nonholonomic mobile robots
    Niu, Wenbin
    Wang, Chaoli
    Li, Qingsong
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2007, 14 : 1462 - 1466
  • [39] Target tracking and obstacle avoidance for mobile robots
    Chancharoen, R
    Sangveraphunsiri, V
    Navakulsirinart, T
    Thanawittayakorn, W
    Boonsanongsupa, W
    Meesaplak, A
    IEEE ICIT' 02: 2002 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS I AND II, PROCEEDINGS, 2002, : 13 - 17
  • [40] An obstacle avoidance-specific reinforcement learning method based on fuzzy attention mechanism and heterogeneous graph neural networks
    Zhang, Feng
    Xuan, Chengbin
    Lam, Hak-Keung
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 130