UAV Path Planning Based on DDQN for Mountain Rescue

被引:2
|
作者
Wang, Yu [1 ]
Jiang, Chuanqi [1 ]
Ren, Tianjun [1 ]
机构
[1] Shenyang Aerosp Univ, Shenyang 110136, Peoples R China
关键词
Mountain rescue; Path planning; Deep reinforcement learning; DDQN; Dynamic target;
D O I
10.1007/978-3-031-13841-6_46
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The high calculation cost and low success rate of strategy generation caused by unknown environment and emergencies, highly limited the usage of traditional UAV path planning methods. A path planning method based on DDQN algorithm is proposed to solve the mountain rescue problem in a complex environment. First, the state space and action space of the UAV are determined, then the reward function is designed based on the positional relationship between target, obstacle and UAV, and finally the DDQN reinforcement learning model based on the greedy strategy is established. Simulation experiments in the two scenarios confirm that the DDQN algorithm can not only achieve path planning for rescuing static goals, but also realize fast-tracking of moving targets through quadratic programming At the same time, compared with the results of the DQN algorithm, it shows that the method has faster network convergence and better path planning ability.
引用
收藏
页码:509 / 516
页数:8
相关论文
共 50 条
  • [1] A DDQN-based path planning algorithm for UAV area detection
    Li, Senhao
    Wang, Bo
    Sheng, Xiao
    Zhao, Tongzhou
    2023 THE 6TH INTERNATIONAL CONFERENCE ON ROBOT SYSTEMS AND APPLICATIONS, ICRSA 2023, 2023, : 30 - 37
  • [2] A Novel UAV Path Planning Method Based on Layered PER-DDQN
    Wang, Weixiang
    Zhang, An
    Bi, Wenhao
    Mao, Zeming
    Li, Minghao
    PROCEEDINGS OF THE 2021 ASIA-PACIFIC INTERNATIONAL SYMPOSIUM ON AEROSPACE TECHNOLOGY (APISAT 2021), VOL 2, 2023, 913 : 693 - 702
  • [3] Path Planning for a Solar-Powered UAV Inspecting Mountain Sites for Safety and Rescue
    Huang, Hailong
    Savkin, Andrey V.
    ENERGIES, 2021, 14 (07)
  • [4] Path Planning of Mountain Search and Rescue Based on Ant Colony Algorithm
    Zhou, Zhihong
    2016 3RD INTERNATIONAL CONFERENCE ON ECONOMIC, BUSINESS MANAGEMENT AND EDUCATIONAL INNOVATION (EBMEI 2016), PT 2, 2016, 55 : 644 - 648
  • [5] UAV Intelligent Path Planning for Wilderness Search and Rescue
    Lin, Lanny
    Goodrich, Michael A.
    2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, : 709 - 714
  • [6] Unmanned Aerial Vehicle Path Planning Based on Improved DDQN Algorithm
    Chen, Desheng
    Wen, Jiabao
    Xi, Meng
    Xiao, Shuai
    Yang, Jiachen
    19TH IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING, BMSB 2024, 2024, : 599 - 604
  • [7] A novel modified search and rescue optimization algorithm based on reinforcement learning for UAV path planning
    Zhou W.-J.
    Zhang C.-Q.
    Tang W.-D.
    Yi Y.-H.
    Liu W.-W.
    Qin W.-D.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (04): : 1203 - 1211
  • [8] Optimal Energy Consumption Path Planning of UAV on Mountain Region Based on Simulated Annealing Algorithm
    Fan Y.
    Shen K.
    Wang D.
    Zhai C.
    Zhang H.
    Wang, Dong (wangdong510@163.com), 1600, Chinese Society of Agricultural Machinery (51): : 34 - 41
  • [9] UAV path planning in mountain areas based on a hybrid parallel compact arithmetic optimization algorithm
    Wang, Ruo-Bin
    Wang, Wei-Feng
    Geng, Fang-Dong
    Pan, Jeng-Shyang
    Chu, Shu-Chuan
    Xu, Lin
    NEURAL COMPUTING & APPLICATIONS, 2023,
  • [10] Multi-UAV Coverage Path Planning Based on Hexagonal Grid Decomposition in Maritime Search and Rescue
    Cho, Sung-Won
    Park, Jin-Hyoung
    Park, Hyun-Ji
    Kim, Seongmin
    MATHEMATICS, 2022, 10 (01)