Q-Learning for autonomous vehicle navigation

被引:0
|
作者
Gonzalez-Miranda, Oscar [1 ]
Miranda, Luis Antonio Lopez [1 ]
Ibarra-Zannatha, Juan Manuel [1 ]
机构
[1] CINVESTAV, Dept Automat Control, Mexico City, DF, Mexico
关键词
Autonomous vehicles; lane-keeping; q-learning; reinforcement learning;
D O I
10.1109/COMROB60035.2023.10349747
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this work, we proposed and developed a reinforcement Q-learning method to do the lane-keeping and obstacle evasion driving maneuvers. We detail how to design a simple car simulator and how to use it to do the training. For each problem, we define different states, actions, and reward functions to obtain a Q-table. Next, we use it as a driving maneuver controller in a different simulation environment. With this method, our car successfully droves on a road different to where it was training. An important conclusion is the possibility to build, more complex controllers to do passing or behavior selectors.
引用
收藏
页码:138 / 142
页数:5
相关论文
共 50 条
  • [1] Autonomous Navigation based on a Q-learning algorithm for a Robot in a Real Environment
    Strauss, Clement
    Sahin, Ferat
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEM OF SYSTEMS ENGINEERING (SOSE), 2008, : 361 - 365
  • [2] An improved Q-learning algorithm for an autonomous mobile robot navigation problem
    Muhammad, Jawad
    Bucak, Ihsan Omur
    2013 INTERNATIONAL CONFERENCE ON TECHNOLOGICAL ADVANCES IN ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING (TAEECE), 2013, : 239 - 243
  • [3] Integrated autonomous optical navigation using Q-Learning extended Kalman filter
    Xiong, Kai
    Wei, Chunling
    Zhou, Peng
    AIRCRAFT ENGINEERING AND AEROSPACE TECHNOLOGY, 2022, 94 (06): : 848 - 861
  • [4] Designing a Mobile Manipulator and Motion Planning for Autonomous Navigation with A* and Q-learning Algorithms
    Kaimujjaman, Md
    Nishi, Tatsushi
    Fujiwara, Tomofumi
    Liu, Ziang
    PROCEEDINGS OF 2024 INTERNATIONAL SYMPOSIUM ON FLEXIBLE AUTOMATION, ISFA 2024, 2024,
  • [5] Comparison of Deep Q-Learning, Q-Learning and SARSA Reinforced Learning for Robot Local Navigation
    Anas, Hafiq
    Ong, Wee Hong
    Malik, Owais Ahmed
    ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS 6, 2022, 429 : 443 - 454
  • [6] Double Deep Q-Learning and Faster R-CNN-Based Autonomous Vehicle Navigation and Obstacle Avoidance in Dynamic Environment
    Bin Issa, Razin
    Das, Modhumonty
    Rahman, Md. Saferi
    Barua, Monika
    Rhaman, Md. Khalilur
    Ripon, Kazi Shah Nawaz
    Alam, Md. Golam Rabiul
    SENSORS, 2021, 21 (04) : 1 - 24
  • [7] Tabular Q-learning Based Reinforcement Learning Agent for Autonomous Vehicle Drift Initiation and Stabilization
    Toth, Szilard H.
    Bardos, Adam
    Viharos, Zsolt J.
    IFAC PAPERSONLINE, 2023, 56 (02): : 4896 - 4903
  • [8] Q-learning Based Obstacle Avoidance Control of Autonomous Underwater Vehicle with Binocular Vision
    Zhang, Liang
    Yan, Jing
    Yang, Xian
    Luo, Xiaoyuan
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 4293 - 4298
  • [9] Heading Control for an Autonomous Underwater Vehicle Using ELM-based Q-Learning
    Wang, Dianrui
    Shen, Yue
    Sha, Qixin
    Li, Guangliang
    Jiang, Jingtao
    Yan, Tianhong
    Wan, Junhe
    He, Bo
    2017 IEEE UNDERWATER TECHNOLOGY (UT), 2017,
  • [10] An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle
    Zhao, Liping
    Li, Feng
    Sun, Dongye
    Zhao, Zihan
    INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2024, 19 (03) : 1 - 15