Autonomous vehicle extreme control for emergency collision avoidance via Reachability-Guided reinforcement learning

被引:2
|
作者
Zhao, Shiyue [1 ]
Zhang, Junzhi [1 ,2 ]
He, Chengkun [1 ]
Ji, Yuan [3 ]
Huang, Heye [4 ]
Hou, Xiaohui [1 ]
机构
[1] Tsinghua Univ, Sch Vehicle & Mobil, Beijing, Peoples R China
[2] Tsinghua Univ, State Key Lab Intelligent Green Vehicle & Mobil, Beijing, Peoples R China
[3] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore 639798, Singapore
[4] Univ Wisconsin Madison, Dept Civil & Environm Engn, Madison, WI 53706 USA
关键词
Autonomous vehicles; Collision avoidance; Extreme control; Min-BRT; reachability-guided RL;
D O I
10.1016/j.aei.2024.102801
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The emergency collision avoidance capabilities of autonomous vehicles (AVs) are crucial for enhancing their active safety performance, particularly in extreme scenarios where standard methods fall short. This study introduces an Extreme Maneuver Controller (EMC) for AVs, utilizing reachability-guided reinforcement learning (RL) to address these challenging situations. By applying pseudospectral methods, we solve the minimum backward reachable tube (Min-BRT) to identify regions where conventional avoidance maneuvers are infeasible, establishing a theoretical basis for triggering extreme maneuvers. A novel controller, employing reachabilityguided RL, enables vehicles to execute extreme maneuvers to escape these critical regions. During training, the value function derived from the Min-BRT solution informs the initialization of the Critic networks, enhancing training efficiency. Real-world scenario-based experimental results with actual vehicles validate that the proposed policy, effectively executes beyond-the-limit maneuvers, mitigating collision risks under emergency condition. Furthermore, these extreme maneuvers are executed with minimal deviation from the original driving objectives, ensuring a smooth and stable transition upon completion of extreme maneuvers.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Deep Reinforcement Learning for Collision Avoidance of Autonomous Vehicle
    Tseng, Hsiao-Ting
    Hsieh, Chen-Chiung
    Lin, Wei-Ting
    Lin, Jyun-Ting
    2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TAIWAN), 2020,
  • [2] Emergency steering control of autonomous vehicle for collision avoidance and stabilisation
    He, Xiangkun
    Liu, Yulong
    Lv, Chen
    Ji, Xuewu
    Liu, Yahui
    VEHICLE SYSTEM DYNAMICS, 2019, 57 (08) : 1163 - 1187
  • [3] Wireless Control of Autonomous Guided Vehicle Using Reinforcement Learning
    Ana, Pedro M. de Sant
    Marchenko, Nikolaj
    Popovski, Petar
    Soret, Beatriz
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [4] Taming an Autonomous Surface Vehicle for Path Following and Collision Avoidance Using Deep Reinforcement Learning
    Meyer, Eivind
    Robinson, Haakon
    Rasheed, Adil
    San, Omer
    IEEE ACCESS, 2020, 8 : 41466 - 41481
  • [5] The optimal Maneuver decision of collision avoidance for autonomous vehicle in emergency conditions
    Wang S.F.
    Chen M.X.
    Zhang D.W.
    Zhang J.Y.
    Advances in Transportation Studies, 2020, 52 : 55 - 70
  • [6] Path Tracking and Handling Stability Control Strategy With Collision Avoidance for the Autonomous Vehicle Under Extreme Conditions
    Chen, Yong
    Chen, Sizhong
    Ren, Hongbin
    Gao, Zepeng
    Liu, Zheng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (12) : 14602 - 14617
  • [7] Autonomous Vehicle for Obstacle Detection and Avoidance Using Reinforcement Learning
    Arvind, C. S.
    Senthilnath, J.
    SOFT COMPUTING FOR PROBLEM SOLVING, SOCPROS 2018, VOL 1, 2020, 1048 : 55 - 66
  • [8] Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle
    Prashant Bhopale
    Faruk Kazi
    Navdeep Singh
    Journal of Marine Science and Application, 2019, 18 : 228 - 238
  • [9] Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle
    Bhopale, Prashant
    Kazi, Faruk
    Singh, Navdeep
    JOURNAL OF MARINE SCIENCE AND APPLICATION, 2019, 18 (02) : 228 - 238
  • [10] CONTROL METHOD FOR PATH FOLLOWING AND COLLISION AVOIDANCE OF AUTONOMOUS SHIP BASED ON DEEP REINFORCEMENT LEARNING
    Zhao, Luman
    Roh, Myung-Il
    Lee, Sung-Jun
    JOURNAL OF MARINE SCIENCE AND TECHNOLOGY-TAIWAN, 2019, 27 (04): : 293 - 310