Unity-Based Autonomous Driving Environment: A Platform for Validating Reinforcement Learning Agents

被引:0
|
作者
Gonzalez-Santocildes, Asier [1 ]
Vazquez, Juan-Ignacio [1 ]
机构
[1] Univ Deusto, Fac Engn, Avda Univ 24, Bilbao 48007, Spain
关键词
Artificial Intelligence; Reinforcement Learning; Development of Intelligent Environments; Autonomous Driving;
D O I
10.1007/978-3-031-74186-9_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Our aim in this research is to develop from scratch a unique racing environment in Unity with the goal of implementing and validating various reinforcement learning algorithms. Once the environment is designed, research efforts will be focused on exploring solutions through different RL (Reinforcement Learning) algorithms by modifying rewards, behaviors, and algorithms. To facilitate the implementation of a broader range of algorithms, a Wrapper will be created to allow testing of algorithms using the Stable Baselines 3 library. Additionally, the research will explore the application of different reinforcement learning techniques, such as imitation learning or curriculum learning. After achieving promising results with training a single agent, the research will explore the possibility of training multiple agents simultaneously in the environment to observe how agents learn to interact with each other. Finally, an instructional application will be developed to consolidate the knowledge generated by the various algorithms, enabling users to visually observe the agents' learning progress. In this application, each algorithm will be represented by a car, allowing users to clearly see the performance of different algorithms in races and laps around the track, highlighting their strengths and weaknesses. In summary, the entire research aims to create an instructive and interactive application where the majority of reinforcement learning algorithms can be visually validated in an environment specifically created for the research.
引用
收藏
页码:280 / 291
页数:12
相关论文
共 50 条
  • [21] Simulated Autonomous Driving in a Realistic Driving Environment using Deep Reinforcement Learning and a Deterministic Finite State Machine
    Klose, Patrick
    Mester, Rudolf
    PROCEEDINGS OF 2ND INTERNATIONAL CONFERENCE ON APPLICATIONS OF INTELLIGENT SYSTEMS (APPIS 2019), 2019,
  • [22] Learning autonomous race driving with action mapping reinforcement learning
    Wang, Yuanda
    Yuan, Xin
    Sun, Changyin
    ISA TRANSACTIONS, 2024, 150 : 1 - 14
  • [23] Reinforcement Learning Driving Strategy based on Auxiliary Task for Multi-Scenarios Autonomous Driving
    Sun, Jingbo
    Fang, Xing
    Zhang, Qichao
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1337 - 1342
  • [24] Deep Reinforcement Learning in Agents' Training: Unity ML-Agents
    Almon-Manzano, Laura
    Pastor-Vargas, Rafael
    Troncoso, Jose Manuel Cuadra
    BIO-INSPIRED SYSTEMS AND APPLICATIONS: FROM ROBOTICS TO AMBIENT INTELLIGENCE, PT II, 2022, 13259 : 391 - 400
  • [25] reinforcement learning, autonomous agents, neural networks
    Parker-Holder, Jack
    Rajan, Raghu
    Song, Xingyou
    Biedenkapp, Andre
    Miao, Yingjie
    Eimer, Theresa
    Zhang, Baohe
    Nguyen, Vu
    Calandra, Roberto
    Faust, Aleksandra
    Hutter, Frank
    Lindauer, Marius
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2022, 74 : 517 - 568
  • [26] Offline Reinforcement Learning for Autonomous Driving with Real World Driving Data
    Fang, Xing
    Zhang, Qichao
    Gao, Yinfeng
    Zhao, Dongbin
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3417 - 3422
  • [27] Applications and Challenges of Reinforcement Learning in Autonomous Driving Technology
    He Y.
    Lin H.
    Liu Y.
    Yang L.
    Qu X.
    Tongji Daxue Xuebao/Journal of Tongji University, 2024, 52 (04): : 520 - 531
  • [28] Effect of Number of Lanes on Traffic Characteristics of Reinforcement Learning Based Autonomous Driving
    Aboyeji, Esther
    Ajani, Oladayo S.
    Mallipeddi, Rammohan
    IEEE ACCESS, 2023, 11 : 80199 - 80206
  • [29] Deep reinforcement-learning-based driving policy for autonomous road vehicles
    Makantasis, Konstantinos
    Kontorinaki, Maria
    Nikolos, Ioannis
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (01) : 13 - 24
  • [30] Safe, efficient, and comfortable velocity control based on reinforcement learning for autonomous driving
    Zhu, Meixin
    Wang, Yinhai
    Pu, Ziyuan
    Hu, Jingyun
    Wang, Xuesong
    Ke, Ruimin
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2020, 117