Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning

被引:3
|
作者
Xu, Shu-Yuan [1 ,2 ]
Chen, Xue-Mei [1 ,2 ]
Wang, Zi-Jia [1 ,2 ]
Hu, Yu-Hui [1 ,2 ]
Han, Xin-Tong [2 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, South ZhongGuanCun St, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Adv Technol Res Inst, 8366 Haitang Rd, Jinan 250300, Peoples R China
关键词
CROSSING BEHAVIOR;
D O I
10.1109/ICARM54641.2022.9959664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Decision making at unsignalized intersections is a critical challenge for autonomous vehicles. Navigating through urban intersections requires determining the intentions of other traffic participants. Solving this complex decision-making problem with traditional methods is difficult. To eliminate conflicts at intersections, this paper introduces several deep reinforcement learning algorithms. This research modeled the behavior of drivers at these intersections. Using this, reward functions were designed, and a meta exploration deep deterministic policy gradient was reorganized. Finally, a novel time twin delayed deep deterministic policy gradient algorithm was developed that considered prediction factors. The Carla-Gym simulation platform was used to build an unsignalized intersection model. The experimental results show that the improved deep reinforcement learning method performed better for navigating autonomous vehicles through unsignalized urban intersections.
引用
收藏
页码:672 / 677
页数:6
相关论文
共 50 条
  • [21] A Deep Reinforcement Learning Decision-Making Approach for Adaptive Cruise Control in Autonomous Vehicles
    Ghraizi, Dany
    Talj, Reine
    Francis, Clovis
    2023 21ST INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, ICAR, 2023, : 71 - 78
  • [22] Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning
    Qi, Xiao
    Ye, Yingjun
    Sun, Jian
    CICTP 2019: TRANSPORTATION IN CHINA-CONNECTING THE WORLD, 2019, : 5853 - 5864
  • [23] Deep imitative reinforcement learning with gradient conflict-free for decision-making in autonomous vehicles
    Shan, Zitong
    Zhao, Jian
    Huang, Wenhui
    Zhao, Yang
    Ge, Linhe
    Zhong, Shouren
    Hu, Hongyu
    Lv, Chen
    Zhu, Bing
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2025, 173
  • [24] A Rear Anti-Collision Decision-Making Methodology Based on Deep Reinforcement Learning for Autonomous Commercial Vehicles
    Hu, Weiming
    Li, Xu
    Hu, Jinchao
    Song, Xiang
    Dong, Xuan
    Kong, Dong
    Xu, Qimin
    Ren, Chunxiao
    IEEE SENSORS JOURNAL, 2022, 22 (16) : 16370 - 16380
  • [25] Interactive Decision-making and Planning for Autonomous Driving vehicles in Unsignalized Intersection
    Xu C.
    Zhao W.
    Li L.
    Zhang R.
    Wang C.
    Chen F.
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2023, 59 (14): : 202 - 212
  • [26] A Safety-Enhanced Reinforcement Learning-Based Decision-Making and Motion Planning Method for Left-Turning at Unsignalized Intersections for Automated Vehicles
    Zhang, Lei
    Cheng, Shuhui
    Wang, Zhenpo
    Liu, Jizheng
    Wang, Mingqiang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (11) : 16375 - 16388
  • [27] Decision-making of autonomous vehicles in interactions with jaywalkers: A risk-aware deep reinforcement learning approach
    Zhang, Ziqian
    Li, Haojie
    Chen, Tiantian
    Sze, N. N.
    Yang, Wenzhang
    Zhang, Yihao
    Ren, Gang
    ACCIDENT ANALYSIS AND PREVENTION, 2025, 210
  • [28] A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
    Wang, Zi-jia
    Chen, Xue-mei
    Wang, Pin
    Li, Meng-xi
    Ou, Yang-jia-xin
    Zhang, Han
    JOURNAL OF ADVANCED TRANSPORTATION, 2021, 2021
  • [29] A Decision-making model for autonomous vehicles at urban intersections based on conflict resolution
    Chen, Xue-mei (chenxue781@126.com), 1600, Hindawi Limited (2021):
  • [30] A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
    Li, Ke
    Zhang, Kun
    Zhang, Zhenchong
    Liu, Zekun
    Hua, Shuai
    He, Jianliang
    SENSORS, 2021, 21 (06)