A novel mobile robot navigation method based on deep reinforcement learning

被引:32
|
作者
Quan, Hao [1 ,2 ]
Li, Yansheng [1 ,2 ]
Zhang, Yi [1 ,2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Res Ctr Intelligent Syst & Robot, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Adv Mfg Engn, Chongqing, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; robot exploration; recurrent neural network; DDQN;
D O I
10.1177/1729881420921672
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
At present, the application of mobile robots is more and more extensive, and the movement of mobile robots cannot be separated from effective navigation, especially path exploration. Aiming at navigation problems, this article proposes a method based on deep reinforcement learning and recurrent neural network, which combines double net and recurrent neural network modules with reinforcement learning ideas. At the same time, this article designed the corresponding parameter function to improve the performance of the model. In order to test the effectiveness of this method, based on the grid map model, this paper trains in a two-dimensional simulation environment, a three-dimensional TurtleBot simulation environment, and a physical robot environment, and obtains relevant data for peer-to-peer analysis. The experimental results show that the proposed algorithm has a good improvement in path finding efficiency and path length.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] A Comprehensive Review of Mobile Robot Navigation Using Deep Reinforcement Learning Algorithms in Crowded Environments
    Le, Hoangcong
    Saeedvand, Saeed
    Hsu, Chen-Chien
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2024, 110 (04)
  • [42] Robot Navigation in Crowd Based on Dual Social Attention Deep Reinforcement Learning
    Zeng, Hui
    Hu, Rong
    Huang, Xiaohui
    Peng, Zhiying
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021 (2021)
  • [43] Using the GTSOM Network for Mobile Robot Navigation with Reinforcement Learning
    Menegaz, Mauricio
    Engel, Paulo M.
    IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 716 - 720
  • [44] Reinforcement based mobile robot navigation in dynamic environment
    Jaradat, Mohammad Abdel Kareem
    Al-Rousan, Mohammad
    Quadan, Lara
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2011, 27 (01) : 135 - 149
  • [45] Path Planning Method of Mobile Robot Using Improved Deep Reinforcement Learning
    Wang, Wei
    Wu, Zhenkui
    Luo, Huafu
    Zhang, Bin
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2022, 2022
  • [46] Research on Robot Navigation Method Integrating Safe Convex Space and Deep Reinforcement Learning
    Dong, Mingze
    Wen, Zhuanglei
    Chen, Xiai
    Yang, Jiongkun
    Zeng, Tao
    Binggong Xuebao/Acta Armamentarii, 2024, 45 (12): : 4372 - 4382
  • [47] Crowd-Aware Mobile Robot Navigation Based on Improved Decentralized Structured RNN via Deep Reinforcement Learning
    Zhang, Yulin
    Feng, Zhengyong
    SENSORS, 2023, 23 (04)
  • [48] Mobile Robot Navigation Based on Deep Reinforcement Learning with 2D-LiDAR Sensor using Stochastic Approach
    Beomsoo, Han
    Ravankar, Ankit A.
    Emaru, Takanori
    2021 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SAFETY FOR ROBOTICS (ISR), 2021, : 417 - 422
  • [49] Fuzzy logic and reinforcement learning based approaches for mobile robot navigation in unknown environment
    Cherroun, Lakhmissi
    Boumehraz, Mohamed
    Mediterranean Journal of Measurement and Control, 2013, 9 (03): : 109 - 117
  • [50] Robot Navigation in Crowded Environments Using Deep Reinforcement Learning
    Liu, Lucia
    Dugas, Daniel
    Cesari, Gianluca
    Siegwart, Roland
    Dube, Renaud
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5671 - 5677