End-to-End Reinforcement Learning for Self-driving Car

被引:12
|
作者
Chopra, Rohan [1 ]
Roy, Sanjiban Sekhar [1 ]
机构
[1] VIT Univ, Sch Comp Sci & Engn, Vellore, Tamil Nadu, India
关键词
Deep learning; Reinforcement learning; TORCS; CNN; Deep Q network;
D O I
10.1007/978-981-15-1081-6_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the current self-driving cars make use of multiple algorithms to drive. Furthermore, most of the approaches use supervised learning to train a model to drive the car autonomously. This approach leads to human bias being incorporated into the model. We implement the Deep Q-Learning algorithm to control a simulated car, end-to-end, autonomously. The algorithm is based on reinforcement learning which teaches machines what to do through interactions with the environment. The application of reinforcement learning for driving is of high relevance as it is highly dependent on interactions with the environment. Our model incorporates a CNN as the deep Q network. The system was tested on an open-source car-racing simulator called TORCS. The Deep Q-Learning approach allows the system to be more efficient and robust than a system that has been trained solely through supervised training. Our simulation results show that the system is able to drive autonomously and maneuver complex curves.
引用
收藏
页码:53 / 61
页数:9
相关论文
共 50 条
  • [31] Chauffeur: Benchmark Suite for Design and End-to-End Analysis of Self-Driving Vehicles on Embedded Systems
    Maity, Biswadip
    Yi, Saehanseul
    Seo, Dongjoo
    Cheng, Leming
    Lim, Sung-Soo
    Kim, Jong-Chan
    Donyanavard, Bryan
    Dutt, Nikil
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2021, 20 (05)
  • [32] End-to-end Autonomous Driving in Heterogeneous Traffic Scenario Using Deep Reinforcement Learning
    Chakraborty, Soumyajit
    Kumar, Subhadeep
    Bhatt, Nirav
    Pasumarthy, Ramkrishna
    2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [33] End-to-End Real-Time Obstacle Detection Network for Safe Self-Driving via Multi-Task Learning
    Song, Taek-Jin
    Jeong, Jongoh
    Kim, Jong-Hwan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) : 16318 - 16329
  • [34] Reinforcement Learning for Vision-Based Lateral Control of a Self-Driving Car
    Huang, Mengzhe
    Zhao, Mingyu
    Parikh, Parthiv
    Wang, Yebin
    Ozbay, Kaan
    Jiang, Zhong-Ping
    2019 IEEE 15TH INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2019, : 1126 - 1131
  • [35] Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning
    Sharma, Archit
    Ahmed, Ahmed M.
    Ahmad, Rehaan
    Finn, Chelsea
    CONFERENCE ON ROBOT LEARNING, VOL 229, 2023, 229
  • [36] Slasher: Stadium racer car for event camera end-to-end learning autonomous driving experiments
    Hu, Yuhuang
    Chen, Hong Ming
    Delbruck, Tobi
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2019), 2019, : 29 - 33
  • [37] Sample Efficient Interactive End-to-End Deep Learning for Self-Driving Cars with Selective Multi-Class Safe Dataset Aggregation
    Bicer, Yunus
    Alizadeh, Ali
    Ure, Nazim Kemal
    Erdogan, Ahmetcan
    Kizilirmak, Orkun
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 2629 - 2634
  • [38] SDC-Net plus plus : End-to-End Crash Detection and Action Control for Self-Driving Car Deep-IoT-Based System
    Tolba, Mohammed Abdou
    Kamal, Hanan Ahmed
    SENSORS, 2024, 24 (12)
  • [39] End-to-End Model-Free Reinforcement Learning for Urban Driving using Implicit Affordances
    Toromanoff, Marin
    Wirbel, Emilie
    Moutarde, Fabien
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7151 - 7160
  • [40] End-to-end Driving via Conditional Imitation Learning
    Codevilla, Felipe
    Mueller, Matthias
    Lopez, Antonio
    Koltun, Vladlen
    Dosovitskiy, Alexey
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 4693 - 4700