Safe reinforcement learning with mixture density network, with application to autonomous driving

被引:11
|
作者
Baheri, Ali [1 ]
机构
[1] West Virginia Univ, Dept Aerosp & Mech Engn, Morgantown, WV 26505 USA
来源
关键词
Safe reinforcement learning; Multimodal trajectory prediction; Mixture density network; Autonomous highway driving;
D O I
10.1016/j.rico.2022.100095
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper presents a safe reinforcement learning system for automated driving that benefits from multimodal future trajectory predictions. We propose a safety system that consists of two safety components: a rule -based and a multimodal learning -based safety system. The rule -based module is based on common driving rules. On the other hand, the multi -modal learningbased safety module is a data -driven safety rule that learns safety patterns from historical driving data. Specifically, it utilizes mixture density recurrent neural networks (MD-RNN) for multimodal future trajectory predictions to mimic the potential behaviors of an autonomous agent and consequently accelerate the learning process. Our simulation results demonstrate that the proposed safety system outperforms previously reported results in terms of average reward and collision frequency.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios
    Liu, Yuqi
    Zhang, Qichao
    Zhao, Dongbin
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [42] Guided Hierarchical Reinforcement Learning for Safe Urban Driving
    Albilani, Mohamad
    Bouzeghoub, Amel
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 746 - 753
  • [43] Decision-making with Triple Density Awareness for Autonomous Driving using Deep Reinforcement Learning
    Zhang, Shuwei
    Wu, Yutian
    Ogai, Harutoshi
    Tateno, Shigeyuki
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [44] Reinforcement Learning and Deep Learning Based Lateral Control for Autonomous Driving
    Li, Dong
    Zhao, Dongbin
    Zhang, Qichao
    Chen, Yaran
    IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2019, 14 (02) : 83 - 98
  • [45] Reinforcement Learning for Joint V2I Network Selection and Autonomous Driving Policies
    Yan, Zijiang
    Tabassum, Hina
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1241 - 1246
  • [46] A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning
    Lv, Kexuan
    Pei, Xiaofei
    Chen, Ci
    Xu, Jie
    MATHEMATICS, 2022, 10 (09)
  • [47] Safe Adaptive Deep Reinforcement Learning for Autonomous Driving in Urban Environments. Additional Filter? How and Where?
    Alighanbari, Sina
    Azad, Nasser L.
    IEEE ACCESS, 2021, 9 : 141347 - 141359
  • [48] Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving
    Wu, Jingda
    Huang, Zhiyu
    Lv, Chen
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 194 - 203
  • [49] Safe Reinforcement Learning for Urban Driving using Invariably Safe Braking Sets
    Krasowski, Hanna
    Zhang, Yinqiang
    Althoff, Matthias
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2407 - 2414
  • [50] A Deep Reinforcement Learning Algorithm with Expert Demonstrations and Supervised Loss and its application in Autonomous Driving
    Liu, Kai
    Wan, Qin
    Li, Yanjie
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 2944 - 2949