Autonomous vehicle extreme control for emergency collision avoidance via Reachability-Guided reinforcement learning

被引:2
|
作者
Zhao, Shiyue [1 ]
Zhang, Junzhi [1 ,2 ]
He, Chengkun [1 ]
Ji, Yuan [3 ]
Huang, Heye [4 ]
Hou, Xiaohui [1 ]
机构
[1] Tsinghua Univ, Sch Vehicle & Mobil, Beijing, Peoples R China
[2] Tsinghua Univ, State Key Lab Intelligent Green Vehicle & Mobil, Beijing, Peoples R China
[3] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore 639798, Singapore
[4] Univ Wisconsin Madison, Dept Civil & Environm Engn, Madison, WI 53706 USA
关键词
Autonomous vehicles; Collision avoidance; Extreme control; Min-BRT; reachability-guided RL;
D O I
10.1016/j.aei.2024.102801
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The emergency collision avoidance capabilities of autonomous vehicles (AVs) are crucial for enhancing their active safety performance, particularly in extreme scenarios where standard methods fall short. This study introduces an Extreme Maneuver Controller (EMC) for AVs, utilizing reachability-guided reinforcement learning (RL) to address these challenging situations. By applying pseudospectral methods, we solve the minimum backward reachable tube (Min-BRT) to identify regions where conventional avoidance maneuvers are infeasible, establishing a theoretical basis for triggering extreme maneuvers. A novel controller, employing reachabilityguided RL, enables vehicles to execute extreme maneuvers to escape these critical regions. During training, the value function derived from the Min-BRT solution informs the initialization of the Critic networks, enhancing training efficiency. Real-world scenario-based experimental results with actual vehicles validate that the proposed policy, effectively executes beyond-the-limit maneuvers, mitigating collision risks under emergency condition. Furthermore, these extreme maneuvers are executed with minimal deviation from the original driving objectives, ensuring a smooth and stable transition upon completion of extreme maneuvers.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Multi-robot Target Encirclement Control with Collision Avoidance via Deep Reinforcement Learning
    Ma, Junchong
    Lu, Huimin
    Xiao, Junhao
    Zeng, Zhiwen
    Zheng, Zhiqiang
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 99 (02) : 371 - 386
  • [32] Research on Safety of Vehicle Emergency Collision Avoidance Based on Optimal Control
    Liu, Yingjie
    Zhao, Youqun
    Zhou, Xiaofeng
    2013 FIFTH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA 2013), 2013, : 923 - 926
  • [33] Multi-robot Target Encirclement Control with Collision Avoidance via Deep Reinforcement Learning
    Junchong Ma
    Huimin Lu
    Junhao Xiao
    Zhiwen Zeng
    Zhiqiang Zheng
    Journal of Intelligent & Robotic Systems, 2020, 99 : 371 - 386
  • [34] A vehicle lateral control approach for collision avoidance by emergency steering maneuvers
    Keller, Martin
    Hass, Carsten
    Seewald, Alois
    Bertram, Torsten
    6TH INTERNATIONAL MUNICH CHASSIS SYMPOSIUM 2015, 2015, : 175 - 197
  • [35] Automatic Synthesis via Tulip of an Autonomous Vehicle Controller ensuring Collision Avoidance
    Kabbani, Tarek
    Di Gennaro, Stefano
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 6699 - 6704
  • [36] Neural reinforcement learning for the control of an autonomous mobile vehicle
    Cicirelli, G
    D'Orazio, T
    Ancona, N
    Distante, A
    IASTED: PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON ROBOTICS AND APPLICATIONS, 2003, : 18 - 23
  • [37] Cooperative Collision Avoidance for Multi-Vehicle Systems Using Reinforcement Learning
    Wang, Qichen
    Phillips, Chris
    2013 18TH INTERNATIONAL CONFERENCE ON METHODS AND MODELS IN AUTOMATION AND ROBOTICS (MMAR), 2013, : 98 - 102
  • [38] Multigoal Visual Navigation With Collision Avoidance via Deep Reinforcement Learning
    Xiao, Wendong
    Yuan, Liang
    He, Li
    Ran, Teng
    Zhang, Jianbo
    Cui, Jianping
    IEEE Transactions on Instrumentation and Measurement, 2022, 71
  • [39] Multigoal Visual Navigation With Collision Avoidance via Deep Reinforcement Learning
    Xiao, Wendong
    Yuan, Liang
    He, Li
    Ran, Teng
    Zhang, Jianbo
    Cui, Jianping
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [40] Self-scheduled H∞ control of autonomous vehicle in collision avoidance maneuvers
    Penco, Dario
    Davins-Valldaura, Joan
    Godoy, Emmanuel
    Kvieska, Pedro
    Valmorbida, Giorgio
    IFAC PAPERSONLINE, 2021, 54 (08): : 148 - 153