Autonomous vehicle extreme control for emergency collision avoidance via Reachability-Guided reinforcement learning

被引:2
|
作者
Zhao, Shiyue [1 ]
Zhang, Junzhi [1 ,2 ]
He, Chengkun [1 ]
Ji, Yuan [3 ]
Huang, Heye [4 ]
Hou, Xiaohui [1 ]
机构
[1] Tsinghua Univ, Sch Vehicle & Mobil, Beijing, Peoples R China
[2] Tsinghua Univ, State Key Lab Intelligent Green Vehicle & Mobil, Beijing, Peoples R China
[3] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore 639798, Singapore
[4] Univ Wisconsin Madison, Dept Civil & Environm Engn, Madison, WI 53706 USA
关键词
Autonomous vehicles; Collision avoidance; Extreme control; Min-BRT; reachability-guided RL;
D O I
10.1016/j.aei.2024.102801
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The emergency collision avoidance capabilities of autonomous vehicles (AVs) are crucial for enhancing their active safety performance, particularly in extreme scenarios where standard methods fall short. This study introduces an Extreme Maneuver Controller (EMC) for AVs, utilizing reachability-guided reinforcement learning (RL) to address these challenging situations. By applying pseudospectral methods, we solve the minimum backward reachable tube (Min-BRT) to identify regions where conventional avoidance maneuvers are infeasible, establishing a theoretical basis for triggering extreme maneuvers. A novel controller, employing reachabilityguided RL, enables vehicles to execute extreme maneuvers to escape these critical regions. During training, the value function derived from the Min-BRT solution informs the initialization of the Critic networks, enhancing training efficiency. Real-world scenario-based experimental results with actual vehicles validate that the proposed policy, effectively executes beyond-the-limit maneuvers, mitigating collision risks under emergency condition. Furthermore, these extreme maneuvers are executed with minimal deviation from the original driving objectives, ensuring a smooth and stable transition upon completion of extreme maneuvers.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Vision-guided Collision Avoidance through Deep Reinforcement Learning
    Song, Sirui
    Zhang, Yuanhang
    Qin, Xi
    Saunders, Kirk
    Liu, Jundong
    PROCEEDINGS OF THE 2021 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2021, : 191 - 194
  • [22] Method for collision avoidance based on deep reinforcement learning with path-speed control for an autonomous ship
    Chun, Do-Hyun
    Roh, Myung-Il
    Lee, Hye-Won
    Yu, Donghun
    INTERNATIONAL JOURNAL OF NAVAL ARCHITECTURE AND OCEAN ENGINEERING, 2024, 16
  • [23] Simulation research on emergency path planning of an active collision avoidance system combined with longitudinal control for an autonomous vehicle
    Cao, Haotian
    Song, Xiaolin
    Huang, Zhengyu
    Pan, Lubin
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2016, 230 (12) : 1624 - 1653
  • [24] UAV autonomous obstacle avoidance via causal reinforcement learning
    Sun, Tao
    Gu, Jiaojiao
    Mou, Junjie
    DISPLAYS, 2025, 87
  • [25] Adversarial Reinforcement Learning Framework for Benchmarking Collision Avoidance Mechanisms in Autonomous Vehicles
    Behzadan, Vahid
    Munir, Arslan
    IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2021, 13 (02) : 236 - 241
  • [26] Deep reinforcement learning with predictive auxiliary task for autonomous train collision avoidance
    Plissonneau, Antoine
    Jourdan, Luca
    Trentesaux, Damien
    Abdi, Lotfi
    Sallak, Mohamed
    Bekrar, Abdelghani
    Quost, Benjamin
    Schoen, Walter
    JOURNAL OF RAIL TRANSPORT PLANNING & MANAGEMENT, 2024, 31
  • [27] Research on autonomous collision avoidance of merchant ship based on inverse reinforcement learning
    Zheng, Mao
    Xie, Shuo
    Chu, Xiumin
    Zhu, Tianquan
    Tian, Guohao
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (06)
  • [28] Formation Control with Collision Avoidance through Deep Reinforcement Learning
    Sui, Zezhi
    Pu, Zhiqiang
    Yi, Jianqiang
    Xiong, Tianyi
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [29] A Decision-Making Strategy for Vehicle Autonomous Braking in Emergency via Deep Reinforcement Learning
    Fu, Yuchuan
    Li, Changle
    Yu, Fei Richard
    Luan, Tom H.
    Zhang, Yao
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (06) : 5876 - 5888
  • [30] Formation Control With Collision Avoidance Through Deep Reinforcement Learning Using Model-Guided Demonstration
    Sui, Zezhi
    Pu, Zhiqiang
    Yi, Jianqiang
    Wu, Shiguang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (06) : 2358 - 2372