Path Planning and Tracking Control for Parking via Soft Actor-Critic Under Non-Ideal Scenarios

被引:18
|
作者
Tang, Xiaolin [1 ]
Yang, Yuyou [1 ]
Liu, Teng [1 ,2 ,3 ]
Lin, Xianke [4 ]
Yang, Kai [1 ]
Li, Shen [5 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[2] Chongqing Univ Three Gorges Hosp, Three Gorges Hosp, Clin Res Ctr, Wanzhou 404000, Peoples R China
[3] Chongqing Univ, Three Gorges Hosp, Med Pathol Ctr, Wanzhou 404000, Peoples R China
[4] Ontario Tech Univ, Dept Automot & Mechatron Engn, Oshawa, ON L1G 0C5, Canada
[5] Tsinghua Univ, Sch Civil Engn, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Automatic parking; control strategy; parking deviation (APS); soft actor-critic (SAC);
D O I
10.1109/JAS.2023.123975
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Parking in a small parking lot within limited space poses a difficult task. It often leads to deviations between the final parking posture and the target posture. These deviations can lead to partial occupancy of adjacent parking lots, which poses a safety threat to vehicles parked in these parking lots. However, previous studies have not addressed this issue. In this paper, we aim to evaluate the impact of parking deviation of existing vehicles next to the target parking lot (PDEVNTPL) on the automatic ego vehicle (AEV) parking, in terms of safety, comfort, accuracy, and efficiency of parking. A segmented parking training framework (SPTF) based on soft actor-critic (SAC) is proposed to improve parking performance. In the proposed method, the SAC algorithm incorporates strategy entropy into the objective function, to enable the AEV to learn parking strategies based on a more comprehensive understanding of the environment. Additionally, the SPTF simplifies complex parking tasks to maintain the high performance of deep reinforcement learning (DRL). The experimental results reveal that the PDEVNTPL has a detrimental influence on the AEV parking in terms of safety, accuracy, and comfort, leading to reductions of more than 27%, 54%, and 26% respectively. However, the SAC-based SPTF effectively mitigates this impact, resulting in a considerable increase in the parking success rate from 71% to 93%. Furthermore, the heading angle deviation is significantly reduced from 2.25 degrees to 0.43 degrees.
引用
收藏
页码:181 / 195
页数:15
相关论文
共 25 条
  • [1] Path Planning and Tracking Control for Parking via Soft Actor-Critic Under Non-Ideal Scenarios
    Xiaolin Tang
    Yuyou Yang
    Teng Liu
    Xianke Lin
    Kai Yang
    Shen Li
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (01) : 181 - 195
  • [2] Tracking control of AUV via novel soft actor-critic and suboptimal demonstrations
    Zhang, Yue
    Zhang, Tianze
    Li, Yibin
    Zhuang, Yinghao
    OCEAN ENGINEERING, 2024, 293
  • [3] Speed Tracking Control via Online Continuous Actor-Critic learning
    Huang, Zhenhua
    Xu, Xin
    Sun, Zhenping
    Tan, Jun
    Qian, Lilin
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 3172 - 3177
  • [4] Autonomous Underwater Vehicle Path Planning Method of Soft Actor-Critic Based on Game Training
    Wang, Zhuo
    Lu, Hao
    Qin, Hongde
    Sui, Yancheng
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (12)
  • [5] A Path-Planning Method Based on Improved Soft Actor-Critic Algorithm for Mobile Robots
    Zhao, Tinglong
    Wang, Ming
    Zhao, Qianchuan
    Zheng, Xuehan
    Gao, He
    BIOMIMETICS, 2023, 8 (06)
  • [6] Advancements in UAV Path Planning: A Deep Reinforcement Learning Approach with Soft Actor-Critic for Enhanced Navigation
    Guo, Jingrui
    Zhou, Guanzhong
    Huang, Hailong
    Huang, Chao
    UNMANNED SYSTEMS, 2024,
  • [7] Soft Actor-Critic and Risk Assessment-Based Reinforcement Learning Method for Ship Path Planning
    Wang, Jue
    Ji, Bin
    Fu, Qian
    SUSTAINABILITY, 2024, 16 (08)
  • [8] Highway Decision-Making and Motion Planning for Autonomous Driving via Soft Actor-Critic
    Tang, Xiaolin
    Huang, Bing
    Liu, Teng
    Lin, Xianke
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 4706 - 4717
  • [9] Path Planning for Multi-Arm Manipulators Using Soft Actor-Critic Algorithm with Position Prediction of Moving Obstacles via LSTM
    Park, Kwan-Woo
    Kim, MyeongSeop
    Kim, Jung-Su
    Park, Jae-Han
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [10] Trajectory Tracking Control for Robotic Manipulator Based on Soft Actor-Critic and Generative Adversarial Imitation Learning
    Hu, Jintao
    Wang, Fujie
    Li, Xing
    Qin, Yi
    Guo, Fang
    Jiang, Ming
    BIOMIMETICS, 2024, 9 (12)