Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning

被引:3
|
作者
Xu, Shu-Yuan [1 ,2 ]
Chen, Xue-Mei [1 ,2 ]
Wang, Zi-Jia [1 ,2 ]
Hu, Yu-Hui [1 ,2 ]
Han, Xin-Tong [2 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, South ZhongGuanCun St, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Adv Technol Res Inst, 8366 Haitang Rd, Jinan 250300, Peoples R China
关键词
CROSSING BEHAVIOR;
D O I
10.1109/ICARM54641.2022.9959664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Decision making at unsignalized intersections is a critical challenge for autonomous vehicles. Navigating through urban intersections requires determining the intentions of other traffic participants. Solving this complex decision-making problem with traditional methods is difficult. To eliminate conflicts at intersections, this paper introduces several deep reinforcement learning algorithms. This research modeled the behavior of drivers at these intersections. Using this, reward functions were designed, and a meta exploration deep deterministic policy gradient was reorganized. Finally, a novel time twin delayed deep deterministic policy gradient algorithm was developed that considered prediction factors. The Carla-Gym simulation platform was used to build an unsignalized intersection model. The experimental results show that the improved deep reinforcement learning method performed better for navigating autonomous vehicles through unsignalized urban intersections.
引用
收藏
页码:672 / 677
页数:6
相关论文
共 50 条
  • [31] A Reinforcement Learning based Decision-making System with Aggressive Driving Behavior Consideration for Autonomous Vehicles
    Kang, Liuwang
    Shen, Haiying
    2021 18TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2021,
  • [32] Reliable safety decision-making for autonomous vehicles: a safety assurance reinforcement learning
    Niu, Yuchen
    Wang, Yongjie
    Xiao, Mei
    Zhu, Wenying
    Wang, Tao
    TRANSPORTMETRICA B-TRANSPORT DYNAMICS, 2025, 13 (01)
  • [33] Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making
    Al-Sharman, Mohammad
    Dempster, Rowan
    Daoud, Mohamed A.
    Nasr, Mahmoud
    Rayside, Derek
    Melek, William
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) : 12345 - 12356
  • [34] Joint Optimization of Sensing, Decision-Making and Motion-Controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach
    Chen, Longquan
    He, Ying
    Wang, Qiang
    Pan, Weike
    Ming, Zhong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 4642 - 4654
  • [35] An Integrated Lateral and Longitudinal Decision-Making Model for Autonomous Driving Based on Deep Reinforcement Learning
    Cui, Jianxun
    Zhao, Boyuan
    Qu, Mingcheng
    JOURNAL OF ADVANCED TRANSPORTATION, 2023, 2023
  • [36] An Integrated Model for Autonomous Speed and Lane Change Decision-Making Based on Deep Reinforcement Learning
    Peng, Jiankun
    Zhang, Siyu
    Zhou, Yang
    Li, Zhibin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 21848 - 21860
  • [37] A novel deep reinforcement learning for POMDP-based autonomous ship collision decision-making
    Zhang, Xinyu
    Zheng, Kangjie
    Wang, Chengbo
    Chen, Jihong
    Qi, Huaiyuan
    NEURAL COMPUTING & APPLICATIONS, 2023,
  • [38] A Comprehensive Driving Decision-Making Methodology Based on Deep Reinforcement Learning for Automated Commercial Vehicles
    Hu, Weiming
    Li, Xu
    Hu, Jinchao
    Liu, Yan
    Zhou, Jinying
    INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2024, 25 (06) : 1469 - 1483
  • [39] Planning and Decision-making for Connected Autonomous Vehicles at Road Intersections: A Review
    Shen Li
    Keqi Shu
    Chaoyi Chen
    Dongpu Cao
    Chinese Journal of Mechanical Engineering, 2021, 34 (05) : 42 - 59
  • [40] Planning and Decision-making for Connected Autonomous Vehicles at Road Intersections: A Review
    Shen Li
    Keqi Shu
    Chaoyi Chen
    Dongpu Cao
    Chinese Journal of Mechanical Engineering, 2021, 34