Deep reinforcement learning for time-critical wilderness search and rescue using drones

被引:0
|
作者
Ewers, Jan-Hendrik [1 ]
Anderson, David [1 ]
Thomson, Douglas [1 ]
机构
[1] Univ Glasgow, Autonomous Syst & Connect, Glasgow City, Scotland
来源
基金
英国工程与自然科学研究理事会;
关键词
reinforcement learning; search planning; mission planning; autonomous systems; wilderness search and rescue; unmanned aerial vehicle; machine learning;
D O I
10.3389/frobt.2024.1527095
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Traditional search and rescue methods in wilderness areas can be time-consuming and have limited coverage. Drones offer a faster and more flexible solution, but optimizing their search paths is crucial for effective operations. This paper proposes a novel algorithm using deep reinforcement learning to create efficient search paths for drones in wilderness environments. Our approach leverages a priori data about the search area and the missing person in the form of a probability distribution map. This allows the policy to learn optimal flight paths that maximize the probability of finding the missing person quickly. Experimental results show that our method achieves a significant improvement in search times compared to traditional coverage planning and search planning algorithms by over 160 % , a difference that can mean life or death in real-world search operations Additionally, unlike previous work, our approach incorporates a continuous action space enabled by cubature, allowing for more nuanced flight patterns.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Deep Reinforcement Learning Using Optimized Monte Carlo Tree Search in EWN
    Zhang, Yixian
    Li, Zhuoxuan
    Cao, Yiding
    Zhao, Xuan
    Cao, Jinde
    IEEE TRANSACTIONS ON GAMES, 2024, 16 (03) : 544 - 555
  • [42] Computationally Efficient DNN Mapping Search Heuristic using Deep Reinforcement Learning
    Bakshi, Suyash
    Johnsson, Lennart
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2023, 22 (05)
  • [43] Supporting wilderness search and rescue using a camera-equipped mini UAV
    Goodrich, Michael A.
    Morse, Bryan S.
    Gerhardt, Damon
    Cooper, Joseph L.
    Quigley, Morgan
    Adams, Julie A.
    Humphrey, Curtis
    JOURNAL OF FIELD ROBOTICS, 2008, 25 (1-2) : 89 - 110
  • [44] Deep Reinforcement Learning Approach for UAV Search Path Planning In Discrete Time and Space
    Benalaya, Najoua
    Amdouni, Ichrak
    Adjih, Cedric
    Laouiti, Anis
    Saidane, Leila Azouz
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 1437 - 1442
  • [45] Deep reinforcement learning assisted memetic scheduling of drones for railway catenary deicing
    Zheng, Yu-Jun
    Xie, Xi-Cheng
    Zhang, Zhi-Yuan
    Shi, Jin-Tang
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 91
  • [46] Using Deep Learning to Find Victims in Unknown Cluttered Urban Search and Rescue Environments
    Angus Fung
    Long Yu Wang
    Kaicheng Zhang
    Goldie Nejat
    Beno Benhabib
    Current Robotics Reports, 2020, 1 (3): : 105 - 115
  • [47] Autonomous Navigation of Rescue Robot on International Standard Rough Terrain by Using Deep Reinforcement Learning
    Matsuo, Hayato
    Sato, Noritaka
    Morita, Yoshifumi
    2023 IEEE INTERNATIONAL SYMPOSIUM ON SAFETY, SECURITY, AND RESCUE ROBOTICS, SSRR, 2023, : 153 - 158
  • [48] Delay Laxity-Based Scheduling with Double-Deep Q-Learning for Time-Critical Applications
    Ren, Xiangyu
    Ji, Jiequ
    Cai, Lin
    2022 IEEE 30TH INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS (ICNP 2022), 2022,
  • [49] Collaborative Deep Reinforcement Learning for Joint Object Search
    Kong, Xiangyu
    Xin, Bo
    Wang, Yizhou
    Hua, Gang
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 7072 - 7081
  • [50] Efficient Novelty Search Through Deep Reinforcement Learning
    Shi, Longxiang
    Li, Shijian
    Zheng, Qian
    Yao, Min
    Pan, Gang
    IEEE ACCESS, 2020, 8 : 128809 - 128818