End-to-End Reinforcement Learning for Self-driving Car

被引:12
|
作者
Chopra, Rohan [1 ]
Roy, Sanjiban Sekhar [1 ]
机构
[1] VIT Univ, Sch Comp Sci & Engn, Vellore, Tamil Nadu, India
关键词
Deep learning; Reinforcement learning; TORCS; CNN; Deep Q network;
D O I
10.1007/978-981-15-1081-6_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the current self-driving cars make use of multiple algorithms to drive. Furthermore, most of the approaches use supervised learning to train a model to drive the car autonomously. This approach leads to human bias being incorporated into the model. We implement the Deep Q-Learning algorithm to control a simulated car, end-to-end, autonomously. The algorithm is based on reinforcement learning which teaches machines what to do through interactions with the environment. The application of reinforcement learning for driving is of high relevance as it is highly dependent on interactions with the environment. Our model incorporates a CNN as the deep Q network. The system was tested on an open-source car-racing simulator called TORCS. The Deep Q-Learning approach allows the system to be more efficient and robust than a system that has been trained solely through supervised training. Our simulation results show that the system is able to drive autonomously and maneuver complex curves.
引用
收藏
页码:53 / 61
页数:9
相关论文
共 50 条
  • [21] The Effects of Speed and Delays on Test-Time Performance of End-to-End Self-Driving
    Tampuu, Ardi
    Roosild, Kristjan
    Uduste, Ilmar
    SENSORS, 2024, 24 (06)
  • [22] CNN based Reinforcement Learning for Driving Behavior of Simulated Self-Driving Car
    Cho Y.
    Lee J.
    Lee K.
    Transactions of the Korean Institute of Electrical Engineers, 2020, 69 (11): : 1740 - 1749
  • [23] Towards End-to-End Chase in Urban Autonomous Driving Using Reinforcement Learning
    Kolomanski, Michal
    Sakhai, Mustafa
    Nowak, Jakub
    Wielgosz, Maciej
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 3, 2023, 544 : 408 - 426
  • [24] Towards End-to-End Escape in Urban Autonomous Driving Using Reinforcement Learning
    Sakhai, Mustafa
    Wielgosz, Maciej
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 21 - 40
  • [25] Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning
    Chen, Jianyu
    Li, Shengbo Eben
    Tomizuka, Masayoshi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 5068 - 5078
  • [26] Stabilization Approaches for Reinforcement Learning-Based End-to-End Autonomous Driving
    Chen, Siyuan
    Wang, Meiling
    Song, Wenjie
    Yang, Yi
    Li, Yujun
    Fu, Mengyin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (05) : 4740 - 4750
  • [27] Deep Reinforcement Learning with external control: Self-driving car application
    Youssef, Fenjiro
    Houda, Benbrahim
    4TH INTERNATIONAL CONFERENCE ON SMART CITY APPLICATIONS (SCA' 19), 2019,
  • [28] End-to-End Self-Driving Approach Independent of Irrelevant Roadside Objects With Auto-Encoder
    Wang, Tinghan
    Luo, Yugong
    Liu, Jinxin
    Chen, Rui
    Li, Keqiang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (01) : 641 - 650
  • [29] End-to-End Self-Driving Using Deep Neural Networks with Multi-auxiliary Tasks
    Wang, Dan
    Wen, Junjie
    Wang, Yuyong
    Huang, Xiangdong
    Pei, Feng
    AUTOMOTIVE INNOVATION, 2019, 2 (02) : 127 - 136
  • [30] End-to-End Self-Driving Using Deep Neural Networks with Multi-auxiliary Tasks
    Dan Wang
    Junjie Wen
    Yuyong Wang
    Xiangdong Huang
    Feng Pei
    Automotive Innovation, 2019, 2 : 127 - 136