Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

被引:2
|
作者
Zhang, Kun [1 ]
Pu, Tonglin [1 ]
Zhang, Qianxi [1 ]
Nie, Zhigen [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Transportat Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
intelligent vehicles; time series prediction; deep reinforcement learning; lane-change and car-following; condition identification; trajectory planning; coordinated control; MODEL; BEHAVIOR;
D O I
10.3390/s24020403
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Adaptive cruise control and autonomous lane-change systems represent pivotal advancements in intelligent vehicle technology. To enhance the operational efficiency of intelligent vehicles in combined lane-change and car-following scenarios, we propose a coordinated decision control model based on hierarchical time series prediction and deep reinforcement learning under the influence of multiple surrounding vehicles. Firstly, we analyze the lane-change behavior and establish boundary conditions for safe lane-change, and divide the lane-change trajectory planning problem into longitudinal velocity planning and lateral trajectory planning. LSTM network is introduced to predict the driving states of surrounding vehicles in multi-step time series, combining D3QN algorithm to make decisions on lane-change behavior. Secondly, based on the following state between the ego vehicle and the leader vehicle in the initial lane, as well as the relationship between the initial distance and the expected distance with the leader vehicle in the target lane, with the primary objective of maximizing driving efficiency, longitudinal velocity is planned based on driving conditions recognition. The lateral trajectory and conditions recognition are then planned using the GA-LSTM-BP algorithm. In contrast to conventional adaptive cruise control systems, the DDPG algorithm serves as the lower-level control model for car-following, enabling continuous velocity control. The proposed model is subsequently simulated and validated using the NGSIM dataset and a lane-change scenarios dataset. The results demonstrate that the algorithm facilitates intelligent vehicle lane-change and car-following coordinated control while ensuring safety and stability during lane-changes. Comparative analysis with other decision control models reveals a notable 17.58% increase in driving velocity, underscoring the algorithm's effectiveness in improving driving efficiency.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Lane-Change Gaming Decision Control Based on Multiple Targets Evaluation for Autonomous Vehicle
    Wang, Yangyang
    Deng, Hangyun
    Chen, Guangda
    TRANSPORTATION RESEARCH RECORD, 2021, 2675 (10) : 254 - 267
  • [22] Deep Reinforcement Learning-Based Decision Making of Lane Change Considering Rear Vehicle Deceleration
    Jo G.-H.
    Park T.-H.
    Journal of Institute of Control, Robotics and Systems, 2022, 28 (06) : 602 - 607
  • [23] A Novel Lane-Change Decision-Making With Long-Time Trajectory Prediction for Autonomous Vehicle
    Wang, Xudong
    Hu, Jibin
    Wei, Chao
    Li, Luhao
    Li, Yongliang
    Du, Miaomiao
    IEEE ACCESS, 2023, 11 : 137437 - 137449
  • [24] Car-following strategy of intelligent connected vehicle using extended disturbance observer adjusted by reinforcement learning
    Yan, Ruidong
    Li, Penghui
    Gao, Hongbo
    Huang, Jin
    Wang, Chengbo
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (02) : 365 - 373
  • [25] Prediction of Vehicle Instantaneous Speed in the Car-Following Based on Machine Learning Approaches
    Jiao, Shuaiyang
    Zhang, Shengrui
    Zhang, Zixuan
    Zhao, Dan
    Zhou, Bei
    CICTP 2020: ADVANCED TRANSPORTATION TECHNOLOGIES AND DEVELOPMENT-ENHANCING CONNECTIONS, 2020, : 3401 - 3412
  • [26] Reinforcement Learning-based Car-Following Control for Autonomous Vehicles with OTFS
    Liu, Yulin
    Shi, Yuye
    Zhang, Xiaoqi
    Wu, Jun
    Yang, Songyuan
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [27] An improved hierarchical deep reinforcement learning algorithm for multi-intelligent vehicle lane change
    Gao, Hongbo
    Zhao, Ming
    Zheng, Xiao
    Wang, Chengbo
    Zhou, Lin
    Wang, Yafei
    Ma, Lei
    Cheng, Bo
    Wu, Zhenyu
    Li, Yuansheng
    NEUROCOMPUTING, 2024, 609
  • [28] Multiobjective adaptive car-following control of an intelligent vehicle based on receding horizon optimization
    Hongbo Gao
    Juping Zhu
    Fei Zhang
    Ruidong Yan
    Junjie Zhou
    Lei Jiang
    Jianqiang Wang
    Keqiang Li
    Science China Information Sciences, 2023, 66
  • [29] Multiobjective adaptive car-following control of an intelligent vehicle based on receding horizon optimization
    Hongbo GAO
    Juping ZHU
    Fei ZHANG
    Ruidong YAN
    Junjie ZHOU
    Lei JIANG
    Jianqiang WANG
    Keqiang LI
    Science China(Information Sciences), 2023, 66 (04) : 301 - 302
  • [30] Multiobjective adaptive car-following control of an intelligent vehicle based on receding horizon optimization
    Gao, Hongbo
    Zhu, Juping
    Zhang, Fei
    Yan, Ruidong
    Zhou, Junjie
    Jiang, Lei
    Wang, Jianqiang
    Li, Keqiang
    SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (04)