Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

被引:2
|
作者
Zhang, Kun [1 ]
Pu, Tonglin [1 ]
Zhang, Qianxi [1 ]
Nie, Zhigen [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Transportat Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
intelligent vehicles; time series prediction; deep reinforcement learning; lane-change and car-following; condition identification; trajectory planning; coordinated control; MODEL; BEHAVIOR;
D O I
10.3390/s24020403
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Adaptive cruise control and autonomous lane-change systems represent pivotal advancements in intelligent vehicle technology. To enhance the operational efficiency of intelligent vehicles in combined lane-change and car-following scenarios, we propose a coordinated decision control model based on hierarchical time series prediction and deep reinforcement learning under the influence of multiple surrounding vehicles. Firstly, we analyze the lane-change behavior and establish boundary conditions for safe lane-change, and divide the lane-change trajectory planning problem into longitudinal velocity planning and lateral trajectory planning. LSTM network is introduced to predict the driving states of surrounding vehicles in multi-step time series, combining D3QN algorithm to make decisions on lane-change behavior. Secondly, based on the following state between the ego vehicle and the leader vehicle in the initial lane, as well as the relationship between the initial distance and the expected distance with the leader vehicle in the target lane, with the primary objective of maximizing driving efficiency, longitudinal velocity is planned based on driving conditions recognition. The lateral trajectory and conditions recognition are then planned using the GA-LSTM-BP algorithm. In contrast to conventional adaptive cruise control systems, the DDPG algorithm serves as the lower-level control model for car-following, enabling continuous velocity control. The proposed model is subsequently simulated and validated using the NGSIM dataset and a lane-change scenarios dataset. The results demonstrate that the algorithm facilitates intelligent vehicle lane-change and car-following coordinated control while ensuring safety and stability during lane-changes. Comparative analysis with other decision control models reveals a notable 17.58% increase in driving velocity, underscoring the algorithm's effectiveness in improving driving efficiency.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Lane-change Behavior Decision-making of Intelligent Vehicle Based on Imitation Learning and Reinforcement Learning
    Song X.
    Sheng X.
    Cao H.
    Li M.
    Yi B.
    Huang Z.
    Qiche Gongcheng/Automotive Engineering, 2021, 43 (01): : 59 - 67
  • [2] Deep Reinforcement Learning Car-Following Control Based on Multivehicle Motion Prediction
    Wang, Tao
    Qu, Dayi
    Wang, Kedong
    Dai, Shouchen
    ELECTRONICS, 2024, 13 (06)
  • [3] Lane-Change Intention Estimation for Car-Following Control in Autonomous Driving
    Zhang, Yihuan
    Lin, Qin
    Wang, Jun
    Verwer, Sicco
    Dolan, John M.
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2018, 3 (03): : 276 - 286
  • [4] SGD-TripleQNet: An Integrated Deep Reinforcement Learning Model for Vehicle Lane-Change Decision
    Liu, Yang
    Yang, Tianxing
    Tian, Liwei
    Pei, Jianbiao
    MATHEMATICS, 2025, 13 (02)
  • [5] A Car-following Control Algorithm Based on Deep Reinforcement Learning
    Zhu B.
    Jiang Y.-D.
    Zhao J.
    Chen H.
    Deng W.-W.
    Zhongguo Gonglu Xuebao/China Journal of Highway and Transport, 2019, 32 (06): : 53 - 60
  • [6] Investigation on hierarchical control for driving stability and safety of intelligent HEV during car-following and lane-change process
    ZHOU YaZhou
    WANG RuoChen
    DING RenKai
    SHI DeHua
    YE Qing
    Science China(Technological Sciences), 2022, (01) : 53 - 76
  • [7] Investigation on hierarchical control for driving stability and safety of intelligent HEV during car-following and lane-change process
    Zhou YaZhou
    Wang RuoChen
    Ding RenKai
    Shi DeHua
    Ye Qing
    SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2022, 65 (01) : 53 - 76
  • [8] Investigation on hierarchical control for driving stability and safety of intelligent HEV during car-following and lane-change process
    ZHOU YaZhou
    WANG RuoChen
    DING RenKai
    SHI DeHua
    YE Qing
    Science China(Technological Sciences), 2022, 65 (01) : 53 - 76
  • [9] Investigation on hierarchical control for driving stability and safety of intelligent HEV during car-following and lane-change process
    YaZhou Zhou
    RuoChen Wang
    RenKai Ding
    DeHua Shi
    Qing Ye
    Science China Technological Sciences, 2022, 65 : 53 - 76
  • [10] Lane-Change Decision of Automatic Driving Based on Reinforcement Learning Framework
    Li, Jiaxin
    Liu, Gang
    Chen, Zhiyu
    Guo, Jianwei
    TRANSPORTATION RESEARCH RECORD, 2024,