Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning

被引:0
|
作者
Bo, Lan [1 ]
Zhang, Tiezhu [1 ]
Zhang, Hongxin [1 ]
Yang, Jian [1 ,2 ]
Zhang, Zhen [1 ]
Zhang, Caihong [3 ]
Liu, Mingjie [1 ]
机构
[1] Qingdao Univ, Coll Mech & Elect Engn, Qingdao 266071, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[3] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Path planning; Q-learning; Flowering plants; Collision avoidance; Heuristic algorithms; Autonomous aerial vehicles; Convergence; unmanned aerial vehicle; obstacle avoidance; reinforcement learning; flower pollination algorithm; COLLISION-AVOIDANCE; NEURAL-NETWORKS; UAV;
D O I
10.1109/ACCESS.2024.3434621
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Planning a path is crucial for safe and efficient Unmanned aerial vehicle flights, especially in complex environments. While the Q-learning algorithm in reinforcement learning performs better in handling such environments, it suffers from slow convergence speed and limited real-time capability. To address these problems, this study proposes an enhanced initialization process using the flower pollination algorithm and employs a tabulation method to improve local obstacle avoidance ability. An improved Q-learning algorithm based on the flower pollination algorithm and tabulation method (IQ-FAT) is proposed, which can perform both global and local path planning, enhance the convergence time of Q-learning, and expedite obstacle avoidance. Evaluation results on various obstacle maps demonstrate that the modified algorithm has a significant improvement convergence speed of approximately 40% compared to the original algorithm while enabling global path planning and local obstacle avoidance. Furthermore, the algorithm demonstrates superior path-planning capabilities in complex environments and enhances the dynamic response time of UAVs by approximately 90% compared to the artificial potential field method.
引用
收藏
页码:104429 / 104444
页数:16
相关论文
共 50 条
  • [41] A Q-learning based multi-strategy integrated artificial bee colony algorithm with application in unmanned vehicle path planning
    Ni, Xinrui
    Hu, Wei
    Fan, Qiaochu
    Cui, Yibing
    Qi, Chongkai
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 236
  • [42] Unmanned Aerial Vehicle Coverage Path Planning Algorithm Based on Cellular Automata
    Song, Zhihua
    Zhang, Han
    Liu, Fei
    Chen, Shitao
    Zhang, Fa
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON INFORMATION SYSTEMS AND COMPUTER AIDED EDUCATION (ICISCAE 2018), 2018, : 371 - 374
  • [43] Unmanned Aerial Vehicle Coverage Path Planning Algorithm based on Cellular Automata
    Song, Zhihua
    Zhang, Han
    Zhang, Xiaojie
    Zhang, Fa
    2019 15TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS 2019), 2019, : 123 - 126
  • [44] A* algorithm based on adaptive expansion convolution for unmanned aerial vehicle path planning
    Xu, Yu
    Li, Yang
    Tai, Yubo
    Lu, Xiaohan
    Jia, Yaodong
    Wang, Yifan
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (03) : 521 - 531
  • [45] Path Planning of an Unmanned Aerial Vehicle Based on a Multi-Strategy Improved Pelican Optimization Algorithm
    Qiu, Shaoming
    Dai, Jikun
    Zhao, Dongsheng
    BIOMIMETICS, 2024, 9 (10)
  • [46] An Improved Artificial Potential Field based Path Planning Algorithm for Unmanned Aerial Vehicle in Dynamic Environments
    Chen, Shoufeng
    Yang, Zhihua
    Liu, Zhentao
    Jin, Haojie
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 591 - 596
  • [47] Unmanned Ground Vehicle Path Planning Based on Improved DRL Algorithm
    Liu, Lisang
    Chen, Jionghui
    Zhang, Youyuan
    Chen, Jiayu
    Liang, Jingrun
    He, Dongwei
    ELECTRONICS, 2024, 13 (13)
  • [48] Unmanned Aerial Vehicle Route Planning Method Based on A Star Algorithm
    Chen, Tianyou
    Zhang, Guofeng
    Hu, Xiaoguang
    Xiao, Jin
    PROCEEDINGS OF THE 2018 13TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2018), 2018, : 1510 - 1514
  • [49] Research on path planning of autonomous vehicle based on RRT algorithm of Q-learning and obstacle distribution
    Shang, Yuze
    Liu, Fei
    Qin, Ping
    Guo, Zhizhong
    Li, Zhe
    ENGINEERING COMPUTATIONS, 2023, 40 (05) : 1266 - 1286
  • [50] Optimal path planning method based on epsilon-greedy Q-learning algorithm
    Bulut, Vahide
    JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING, 2022, 44 (03)