Driver Behavior Modeling via Inverse Reinforcement Learning Based on Particle Swarm Optimization

被引:1
|
作者
Liu, Zeng-Jie [1 ]
Wu, Huai-Ning [1 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Sci & Technol Aircraft Control Lab, Beijing 100191, Peoples R China
关键词
Driver behavior modeling; T-S fuzzy model; inverse reinforcement learning; particle swarm optimization;
D O I
10.1109/CAC51589.2020.9327174
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, an inverse reinforcement learning method based on particle swarm optimization (PSO) is proposed to model driver's steering behavior. Initially, the vehicle dynamics is represented by a Takagi-Sugeno (T-S) fuzzy model which provides a method of approximating Q-function. Then the driver behavior model is described as an optimal control policy with decision-making model which illustrates the driving style. Subsequently, the Q-function is approximated by a quadratic polynomial-in-memberships form and the PSO algorithm is used to obtain the decision-making model from the driving data. And the corresponding optimal control policy is obtained by using the Q-learning policy iteration method. Finally, a numerical simulation is carried to show the effectiveness of the proposed method.
引用
收藏
页码:7232 / 7237
页数:6
相关论文
共 50 条
  • [1] Inverse Reinforcement Learning via Neural Network in Driver Behavior Modeling
    Zou, QiJie
    Li, Haoyu
    Zhang, Rubo
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1245 - 1250
  • [2] Modeling Driver Behavior using Adversarial Inverse Reinforcement Learning
    Sackmann, Moritz
    Bey, Henrik
    Hofmann, Ulrich
    Thielecke, Joern
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 1683 - 1690
  • [3] Swarm Reinforcement Learning Algorithms Based on Particle Swarm Optimization
    Iima, Hitoshi
    Kuroe, Yasuaki
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), VOLS 1-6, 2008, : 1109 - 1114
  • [4] Inverse Reinforcement Learning Based Stochastic Driver Behavior Learning
    Ozkan, Mehmet F.
    Rocque, Abishek J.
    Ma, Yao
    IFAC PAPERSONLINE, 2021, 54 (20): : 882 - 888
  • [5] Modeling Driver Lane Change Behavior Using Inverse Reinforcement Learning
    Zhou, Zhaodong
    Chen, Jun
    2024 IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTING AND MACHINE INTELLIGENCE, ICMI 2024, 2024,
  • [6] A reinforcement learning-based communication topology in particle swarm optimization
    Xu, Yue
    Pi, Dechang
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (14): : 10007 - 10032
  • [7] A reinforcement learning-based communication topology in particle swarm optimization
    Yue Xu
    Dechang Pi
    Neural Computing and Applications, 2020, 32 : 10007 - 10032
  • [8] INVERSE REINFORCEMENT LEARNING BASED DRIVER BEHAVIOR ANALYSIS AND FUEL ECONOMY ASSESSMENT
    Ozkan, Mehmet Fatih
    Ma, Yao
    PROCEEDINGS OF THE ASME DYNAMIC SYSTEMS AND CONTROL CONFERENCE, DSCC2020, VOL 1, 2020,
  • [9] Reinforcement-learning-based parameter adaptation method for particle swarm optimization
    Yin, Shiyuan
    Jin, Min
    Lu, Huaxiang
    Gong, Guoliang
    Mao, Wenyu
    Chen, Gang
    Li, Wenchang
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) : 5585 - 5609
  • [10] Reinforcement learning-based particle swarm optimization for sewage treatment control
    Lu Lu
    Hui Zheng
    Jing Jie
    Miao Zhang
    Rui Dai
    Complex & Intelligent Systems, 2021, 7 : 2199 - 2210