Driver Behavior Modeling via Inverse Reinforcement Learning Based on Particle Swarm Optimization

被引:1
|
作者
Liu, Zeng-Jie [1 ]
Wu, Huai-Ning [1 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Sci & Technol Aircraft Control Lab, Beijing 100191, Peoples R China
关键词
Driver behavior modeling; T-S fuzzy model; inverse reinforcement learning; particle swarm optimization;
D O I
10.1109/CAC51589.2020.9327174
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, an inverse reinforcement learning method based on particle swarm optimization (PSO) is proposed to model driver's steering behavior. Initially, the vehicle dynamics is represented by a Takagi-Sugeno (T-S) fuzzy model which provides a method of approximating Q-function. Then the driver behavior model is described as an optimal control policy with decision-making model which illustrates the driving style. Subsequently, the Q-function is approximated by a quadratic polynomial-in-memberships form and the PSO algorithm is used to obtain the decision-making model from the driving data. And the corresponding optimal control policy is obtained by using the Q-learning policy iteration method. Finally, a numerical simulation is carried to show the effectiveness of the proposed method.
引用
收藏
页码:7232 / 7237
页数:6
相关论文
共 50 条
  • [21] An Adaptive Online Parameter Control Algorithm for Particle Swarm Optimization Based on Reinforcement Learning
    Liu, Yaxian
    Lu, Hui
    Cheng, Shi
    Shi, Yuhui
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 815 - 822
  • [22] Reinforcement learning-based particle swarm optimization for wind farm layout problems
    Zhang, Zihang
    Li, Jiayi
    Lei, Zhenyu
    Zhu, Qianyu
    Cheng, Jiujun
    Gao, Shangce
    Energy, 2024, 313
  • [23] A multi-strategy particle swarm optimization framework based on deep reinforcement learning
    Hou, Leyong
    Fan, Debin
    Cheng, Junjie
    Wu, Honglian
    Peng, Hu
    Deng, Changshou
    2023 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE, ICACI, 2023,
  • [24] Quantum circuit mapping based on discrete particle swarm optimization and deep reinforcement learning
    Li, Yang-Zhi
    Liu, Wen
    Xu, Guo-Sheng
    Li, Mao-Duo
    Chen, Kai
    He, Shou-Li
    SWARM AND EVOLUTIONARY COMPUTATION, 2025, 95
  • [25] Levy flight-based inverse adaptive comprehensive learning particle swarm optimization
    Zhou, Xin
    Zhou, Shangbo
    Han, Yuxiao
    Zhu, Shufang
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (05) : 5241 - 5268
  • [26] Inverse Reinforcement Learning in Swarm Systems
    Sosic, Adrian
    KhudaBukhsh, Wasiur R.
    Zoubir, Abdelhak M.
    Koeppl, Heinz
    AAMAS'17: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2017, : 1413 - 1421
  • [27] PMSM Driver Based on Hybrid Particle Swarm Optimization and CMAC
    Tu, Ji
    Cao, Shaozhong
    2012 INTERNATIONAL CONFERENCE ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING (ICMPBE2012), 2012, 33 : 983 - 990
  • [28] PMSM Driver Based on Hybrid Particle Swarm Optimization and CMAC
    Tu, Ji
    Liu, Heping
    Cao, Shaozhong
    2010 INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT (CCCM2010), VOL III, 2010, : 120 - 123
  • [29] A reinforcement learning level-based particle swarm optimization algorithm for large-scale optimization
    Wang, Feng
    Wang, Xujie
    Sun, Shilei
    INFORMATION SCIENCES, 2022, 602 : 298 - 312
  • [30] Evaluating driver-pedestrian interaction behavior in different environments via Markov-game-based inverse reinforcement learning
    Lanzaro, Gabriel
    Sayed, Tarek
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 260