Driver Behavior Modeling via Inverse Reinforcement Learning Based on Particle Swarm Optimization

被引:1
|
作者
Liu, Zeng-Jie [1 ]
Wu, Huai-Ning [1 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Sci & Technol Aircraft Control Lab, Beijing 100191, Peoples R China
关键词
Driver behavior modeling; T-S fuzzy model; inverse reinforcement learning; particle swarm optimization;
D O I
10.1109/CAC51589.2020.9327174
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, an inverse reinforcement learning method based on particle swarm optimization (PSO) is proposed to model driver's steering behavior. Initially, the vehicle dynamics is represented by a Takagi-Sugeno (T-S) fuzzy model which provides a method of approximating Q-function. Then the driver behavior model is described as an optimal control policy with decision-making model which illustrates the driving style. Subsequently, the Q-function is approximated by a quadratic polynomial-in-memberships form and the PSO algorithm is used to obtain the decision-making model from the driving data. And the corresponding optimal control policy is obtained by using the Q-learning policy iteration method. Finally, a numerical simulation is carried to show the effectiveness of the proposed method.
引用
收藏
页码:7232 / 7237
页数:6
相关论文
共 50 条
  • [41] Adaptive inverse control based on particle swarm optimization algorithm
    Wang, YuShen
    Wang, Kejun
    Qu, JiaSheng
    Yang, YuRong
    2005 IEEE International Conference on Mechatronics and Automations, Vols 1-4, Conference Proceedings, 2005, : 2169 - 2172
  • [42] Inverse design of semiconductor laser parameters based on deep learning and particle swarm optimization method
    Ma, Zihao
    Feng, Pei
    Li, Yu
    ELEVENTH INTERNATIONAL CONFERENCE ON INFORMATION OPTICS AND PHOTONICS (CIOP 2019), 2019, 11209
  • [43] Inverse Lithography Source Optimization via Particle Swarm Optimization and Genetic Combined Algorithm
    Sun, Haifeng
    Zhang, Qingyan
    Jin, Chuan
    Li, Yanli
    Tang, Yan
    Wang, Jian
    Hu, Song
    Liu, Junbo
    IEEE PHOTONICS JOURNAL, 2023, 15 (02):
  • [44] Modeling Eye-Gaze Behavior of Electric Wheelchair Drivers via Inverse Reinforcement Learning
    Maekawa, Yamato
    Akai, Naoki
    Hirayama, Takatsugu
    Morales, Luis Yoichi
    Deguchi, Daisuke
    Kawanishi, Yasutomo
    Ide, Ichiro
    Murase, Hiroshi
    2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,
  • [45] Human-in-the-Loop Behavior Modeling via an Integral Concurrent Adaptive Inverse Reinforcement Learning
    Wu, Huai-Ning
    Wang, Mi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 11359 - 11370
  • [46] Trajectory modeling via random utility inverse reinforcement learning
    Pitombeira-Neto, Anselmo R.
    Santos, Helano P.
    da Silva, Ticiana L. Coelho
    de Macedo, Jose Antonio F.
    INFORMATION SCIENCES, 2024, 660
  • [47] A Review of Geophysical Modeling Based on Particle Swarm Optimization
    Francesca Pace
    Alessandro Santilano
    Alberto Godio
    Surveys in Geophysics, 2021, 42 : 505 - 549
  • [48] A Review of Geophysical Modeling Based on Particle Swarm Optimization
    Pace, Francesca
    Santilano, Alessandro
    Godio, Alberto
    SURVEYS IN GEOPHYSICS, 2021, 42 (03) : 505 - 549
  • [49] Inverse Modeling in Geoenvironmental Engineering Using a Novel Particle Swarm Optimization Algorithm
    Bharat, Tadikonda Venkata
    Sharma, Jitendra
    SWARM INTELLIGENCE, 2010, 6234 : 448 - 455
  • [50] Particle Swarm Optimization for inverse modeling of solute transport in fractured gneiss aquifer
    Abdelaziz, Ramadan
    Zambrano-Bigiarini, Mauricio
    JOURNAL OF CONTAMINANT HYDROLOGY, 2014, 164 : 285 - 298