Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning

被引:0
|
作者
Bo, Lan [1 ]
Zhang, Tiezhu [1 ]
Zhang, Hongxin [1 ]
Yang, Jian [1 ,2 ]
Zhang, Zhen [1 ]
Zhang, Caihong [3 ]
Liu, Mingjie [1 ]
机构
[1] Qingdao Univ, Coll Mech & Elect Engn, Qingdao 266071, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[3] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Path planning; Q-learning; Flowering plants; Collision avoidance; Heuristic algorithms; Autonomous aerial vehicles; Convergence; unmanned aerial vehicle; obstacle avoidance; reinforcement learning; flower pollination algorithm; COLLISION-AVOIDANCE; NEURAL-NETWORKS; UAV;
D O I
10.1109/ACCESS.2024.3434621
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Planning a path is crucial for safe and efficient Unmanned aerial vehicle flights, especially in complex environments. While the Q-learning algorithm in reinforcement learning performs better in handling such environments, it suffers from slow convergence speed and limited real-time capability. To address these problems, this study proposes an enhanced initialization process using the flower pollination algorithm and employs a tabulation method to improve local obstacle avoidance ability. An improved Q-learning algorithm based on the flower pollination algorithm and tabulation method (IQ-FAT) is proposed, which can perform both global and local path planning, enhance the convergence time of Q-learning, and expedite obstacle avoidance. Evaluation results on various obstacle maps demonstrate that the modified algorithm has a significant improvement convergence speed of approximately 40% compared to the original algorithm while enabling global path planning and local obstacle avoidance. Furthermore, the algorithm demonstrates superior path-planning capabilities in complex environments and enhances the dynamic response time of UAVs by approximately 90% compared to the artificial potential field method.
引用
收藏
页码:104429 / 104444
页数:16
相关论文
共 50 条
  • [21] Unmanned Aerial Vehicle Path-Planning Method Based on Improved P-RRT* Algorithm
    Xu, Xing
    Zhang, Feifan
    Zhao, Yun
    ELECTRONICS, 2023, 12 (22)
  • [22] A search and rescue robot search method based on flower pollination algorithm and Q-learning fusion algorithm
    Hao, Bing
    Zhao, Jianshuo
    Du, He
    Wang, Qi
    Yuan, Qi
    Zhao, Shuo
    PLOS ONE, 2023, 18 (03):
  • [23] An Improved Path Planning Algorithm for Unmanned Aerial Vehicle Based on RRT-Connect
    Zhang, Denggui
    Xu, Yong
    Yao, Xingting
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 4854 - 4858
  • [24] Unmanned Aerial Vehicle Path Planning Based on Improved Intelligent Water Drop Algorithm
    Sun, Xixia
    Pan, Su
    Cai, Chao
    Chen, Yanfang
    Chen, Jie
    2018 EIGHTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC 2018), 2018, : 867 - 872
  • [25] Intelligent Vehicle Path Planning Based on Q-Learning Algorithm with Consideration of Smoothness
    Zhao, Wei
    Guo, Hongyan
    Zhao, Xiaoming
    Dai, Qikun
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4192 - 4197
  • [26] Research on Trajectory Planning Algorithm of Unmanned Aerial Vehicle Based on Improved A* algorithm
    Fang Mao-hui
    Xu Jun
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, : 1348 - 1352
  • [27] ETQ-learning: an improved Q-learning algorithm for path planning
    Wang, Huanwei
    Jing, Jing
    Wang, Qianlv
    He, Hongqi
    Qi, Xuyan
    Lou, Rui
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (04) : 915 - 929
  • [28] A novel hybrid improved dingo algorithm for unmanned aerial vehicle path planning
    Wang, Shoubin
    Lv, Xuanman
    Li, Youbing
    Jing, Lewei
    Fang, Xinchang
    Peng, Guili
    Zhou, Yuan
    Sun, Wenhao
    JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING, 2025, 47 (01)
  • [29] Application of Improved Cuckoo Search Algorithm to Path Planning Unmanned Aerial Vehicle
    Xie, Cong
    Zheng, Hongqing
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, ICIC 2016, PT I, 2016, 9771 : 722 - 729
  • [30] Global path planning of unmanned vehicle based on improved A* algorithm
    Liang, Hao
    Du, Xiaofang
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ALGORITHMS, SOFTWARE ENGINEERING, AND NETWORK SECURITY, ASENS 2024, 2024, : 176 - 184