Safe reinforcement learning with mixture density network, with application to autonomous driving

被引:11
|
作者
Baheri, Ali [1 ]
机构
[1] West Virginia Univ, Dept Aerosp & Mech Engn, Morgantown, WV 26505 USA
来源
关键词
Safe reinforcement learning; Multimodal trajectory prediction; Mixture density network; Autonomous highway driving;
D O I
10.1016/j.rico.2022.100095
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper presents a safe reinforcement learning system for automated driving that benefits from multimodal future trajectory predictions. We propose a safety system that consists of two safety components: a rule -based and a multimodal learning -based safety system. The rule -based module is based on common driving rules. On the other hand, the multi -modal learningbased safety module is a data -driven safety rule that learns safety patterns from historical driving data. Specifically, it utilizes mixture density recurrent neural networks (MD-RNN) for multimodal future trajectory predictions to mimic the potential behaviors of an autonomous agent and consequently accelerate the learning process. Our simulation results demonstrate that the proposed safety system outperforms previously reported results in terms of average reward and collision frequency.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Safe Reinforcement Learning in Autonomous Driving With Epistemic Uncertainty Estimation
    Zhang, Zheng
    Liu, Qi
    Li, Yanjie
    Lin, Ke
    Li, Linyu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (10) : 13653 - 13666
  • [2] Application of Reinforcement Learning in the Autonomous Driving Platform of the DeepRacer
    Zhu, Wenjie
    Du, Haikuo
    Zhu, Moyan
    Liu, Yanbo
    Lin, Chaoting
    Wang, Shaobo
    Sun, Weiqi
    Yan, Huaming
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 5345 - 5352
  • [3] Lane Keeping Algorithm for Autonomous Driving via Safe Reinforcement Learning
    Kong, Qi
    Zhang, Liangliang
    Xu, Xin
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, 2021, 12817 : 439 - 450
  • [4] Fear-Neuro-Inspired Reinforcement Learning for Safe Autonomous Driving
    He, Xiangkun
    Wu, Jingda
    Huang, Zhiyu
    Hu, Zhongxu
    Wang, Jun
    Sangiovanni-Vincentelli, Alberto
    Lv, Chen
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (01) : 267 - 279
  • [5] WISEMOVE: A Framework to Investigate Safe Deep Reinforcement Learning for Autonomous Driving
    Lee, Jaeyoung
    Balakrishnan, Aravind
    Gaurav, Ashish
    Czarnecki, Krzysztof
    Sedwards, Sean
    QUANTITATIVE EVALUATION OF SYSTEMS (QEST 2019), 2019, 11785 : 350 - 354
  • [6] Safe and Rule-Aware Deep Reinforcement Learning for Autonomous Driving at Intersections
    Zhang, Chi
    Kacem, Kais
    Hinz, Gereon
    Knoll, Alois
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2708 - 2715
  • [7] Safe, efficient, and comfortable velocity control based on reinforcement learning for autonomous driving
    Zhu, Meixin
    Wang, Yinhai
    Pu, Ziyuan
    Hu, Jingyun
    Wang, Xuesong
    Ke, Ruimin
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2020, 117
  • [8] Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making
    Gao, Fei
    Wang, Xiaodong
    Fan, Yuze
    Gao, Zhenhai
    Zhao, Rui
    IEEE ACCESS, 2024, 12 : 128007 - 128023
  • [9] Attention-Based Distributional Reinforcement Learning for Safe and Efficient Autonomous Driving
    Liu, Jia
    Yin, Jianwen
    Jiang, Zhengmin
    Liang, Qingyi
    Li, Huiyun
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (09): : 7477 - 7484
  • [10] Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network
    Wu, Yuanqing
    Liao, Siqin
    Liu, Xiang
    Li, Zhihang
    Lu, Renquan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) : 3680 - 3690