Driver Behavior Modeling via Inverse Reinforcement Learning Based on Particle Swarm Optimization

被引:1
|
作者
Liu, Zeng-Jie [1 ]
Wu, Huai-Ning [1 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Sci & Technol Aircraft Control Lab, Beijing 100191, Peoples R China
关键词
Driver behavior modeling; T-S fuzzy model; inverse reinforcement learning; particle swarm optimization;
D O I
10.1109/CAC51589.2020.9327174
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, an inverse reinforcement learning method based on particle swarm optimization (PSO) is proposed to model driver's steering behavior. Initially, the vehicle dynamics is represented by a Takagi-Sugeno (T-S) fuzzy model which provides a method of approximating Q-function. Then the driver behavior model is described as an optimal control policy with decision-making model which illustrates the driving style. Subsequently, the Q-function is approximated by a quadratic polynomial-in-memberships form and the PSO algorithm is used to obtain the decision-making model from the driving data. And the corresponding optimal control policy is obtained by using the Q-learning policy iteration method. Finally, a numerical simulation is carried to show the effectiveness of the proposed method.
引用
收藏
页码:7232 / 7237
页数:6
相关论文
共 50 条
  • [31] Pilot Performance Modeling via Observer-Based Inverse Reinforcement Learning
    Town, Jared
    Morrison, Zachary
    Kamalapurkar, Rushikesh
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2024, 32 (06) : 2444 - 2451
  • [32] A modified particle swarm optimization via particle visual modeling analysis
    Zhao, Yuxin
    Zu, Wei
    Zeng, Haitao
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2009, 57 (11-12) : 2022 - 2029
  • [33] Multi-strategy self-learning particle swarm optimization algorithm based on reinforcement learning
    Meng, Xiaoding
    Li, Hecheng
    Chen, Anshan
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (05) : 8498 - 8530
  • [34] Application of particle swarm optimization in inverse finite element modeling to determine the cornea 's mechanical behavior
    Magalhaes, Ricardo
    Elsheikh, Ahmed
    Buchler, Philippe
    Whitford, Charles
    Wang, Junjie
    ACTA SCIENTIARUM-TECHNOLOGY, 2017, 39 (03) : 325 - 331
  • [35] Particle Swarm Optimization and Inverse Problems
    Garcia-Gonzalo, Esperanza
    Luis Fernandez-Martinez, Juan
    COMBINING SOFT COMPUTING AND STATISTICAL METHODS IN DATA ANALYSIS, 2010, 77 : 289 - 296
  • [36] Fault Tolerant Control Using Reinforcement Learning and Particle Swarm Optimization
    Zhang, Dapeng
    Gao, Zhiwei
    IEEE ACCESS, 2020, 8 : 168802 - 168811
  • [37] Particle swarm optimization for generating interpretable fuzzy reinforcement learning policies
    Hein, Daniel
    Hentschel, Alexander
    Runkler, Thomas
    Udluft, Steffen
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2017, 65 : 87 - 98
  • [38] Inverse Dynamics Based Optimal Fuzzy Controller for a Robot Manipulator via Particle Swarm Optimization
    Mahmoodabadi, M. J.
    Ziaei, A.
    JOURNAL OF ROBOTICS, 2019, 2019
  • [39] A new path plan method based on hybrid algorithm of reinforcement learning and particle swarm optimization
    Liu, Xiaohuan
    Zhang, Degan
    Zhang, Ting
    Zhang, Jie
    Wang, Jiaxu
    ENGINEERING COMPUTATIONS, 2022, 39 (03) : 993 - 1019
  • [40] A Novel Particle Swarm Optimization Algorithm Based on Reinforcement Learning Mechanism for AUV Path Planning
    Huang, Haoqian
    Jin, Chao
    COMPLEXITY, 2021, 2021