An End-to-End Deep Reinforcement Learning Model Based on Proximal Policy Optimization Algorithm for Autonomous Driving of Off-Road Vehicle

被引:0
|
作者
Wang, Yiquan [1 ,2 ]
Wang, Jingguo [2 ]
Yang, Yu [1 ]
Li, Zhaodong [1 ]
Zhao, Xijun [1 ]
机构
[1] China North Artificial Intelligence & Innovat Res, Beijing, Peoples R China
[2] Jiuquan Satellite Launch Ctr, Jiuquan, Gansu, Peoples R China
关键词
Reinforcement Learning; End-to-End; UGV; Wild Environment; GROUND VEHICLE;
D O I
10.1007/978-981-99-0479-2_248
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most conventional unmanned vehicle control algorithms require human adjustment of parameters and design of precise rules, thus failing to adapt quickly to multiple situations when facing complex environments in the wild. To address these problems, this paper adopts an end-to-end deep reinforcement learning model based on proximal policy optimization algorithm to control the steering, speed and braking of an unmanned vehicle, allowing it to autonomously learn motion control strategies from perceptionmap in un-known environments. A novel environment simulator which contains variable passable areas and obstacles is also proposed to support agents to achieve target reward. The proposed agent model has been proved to receive the highest reward over SAC and has the ability to overcome the complexity of the wild environment generated by the simulator.
引用
收藏
页码:2692 / 2704
页数:13
相关论文
共 50 条
  • [1] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [2] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [3] Autonomous Off-Road Navigation with End-to-End Learning for the LAGR Program
    Bajracharya, Max
    Howard, Andrew
    Matthies, Larry H.
    Tang, Benyang
    Turmon, Michael
    JOURNAL OF FIELD ROBOTICS, 2009, 26 (01) : 3 - 25
  • [4] Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning
    Chen, Jianyu
    Li, Shengbo Eben
    Tomizuka, Masayoshi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 5068 - 5078
  • [5] Fusion of LiDAR and Camera Images in End-to-end Deep Learning for Steering an Off-road Unmanned Ground Vehicle
    Warakagoda, Narada
    Dirdal, Johann
    Faxvaag, Erlend
    2019 22ND INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2019), 2019,
  • [6] Learning to Drive: End-to-End Off-Road Path Prediction
    Holder, Christopher J.
    Breckon, Toby P.
    IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2021, 13 (02) : 217 - 221
  • [7] End-to-End Race Driving with Deep Reinforcement Learning
    Jaritz, Maximilian
    de Charette, Raoul
    Toromanoff, Marin
    Perot, Etienne
    Nashashibi, Fawzi
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 2070 - 2075
  • [8] Off-policy model-based end-to-end safe reinforcement learning
    Kanso, Soha
    Jha, Mayank Shekhar
    Theilliol, Didier
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (04) : 2806 - 2831
  • [9] End-to-end Autonomous Driving in Heterogeneous Traffic Scenario Using Deep Reinforcement Learning
    Chakraborty, Soumyajit
    Kumar, Subhadeep
    Bhatt, Nirav
    Pasumarthy, Ramkrishna
    2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [10] Improvement of End-to-end Automatic Driving Algorithm Based on Reinforcement Learning
    Tang, Jianlin
    Li, Lingyun
    Ai, Yunfeng
    Zhao, Bin
    Ren, Liangcai
    Tian, Bin
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 5086 - 5091