Deep reinforcement learning for time-critical wilderness search and rescue using drones

被引:0
|
作者
Ewers, Jan-Hendrik [1 ]
Anderson, David [1 ]
Thomson, Douglas [1 ]
机构
[1] Univ Glasgow, Autonomous Syst & Connect, Glasgow City, Scotland
来源
基金
英国工程与自然科学研究理事会;
关键词
reinforcement learning; search planning; mission planning; autonomous systems; wilderness search and rescue; unmanned aerial vehicle; machine learning;
D O I
10.3389/frobt.2024.1527095
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Traditional search and rescue methods in wilderness areas can be time-consuming and have limited coverage. Drones offer a faster and more flexible solution, but optimizing their search paths is crucial for effective operations. This paper proposes a novel algorithm using deep reinforcement learning to create efficient search paths for drones in wilderness environments. Our approach leverages a priori data about the search area and the missing person in the form of a probability distribution map. This allows the policy to learn optimal flight paths that maximize the probability of finding the missing person quickly. Experimental results show that our method achieves a significant improvement in search times compared to traditional coverage planning and search planning algorithms by over 160 % , a difference that can mean life or death in real-world search operations Additionally, unlike previous work, our approach incorporates a continuous action space enabled by cubature, allowing for more nuanced flight patterns.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Project Vulture: A Prototype for Using Drones in Search and Rescue Operations
    Quan, Andres
    Herrmann, Charles
    Soliman, Hamdy
    2019 15TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (DCOSS), 2019, : 619 - 624
  • [22] Reinforcement Learning for Collaborative Search and Rescue Using Unmanned Aircraft System Swarms
    Arnold, Ross
    Osinski, Matthew
    Reddy, Christopher
    Lowey, Austin
    2022 IEEE INTERNATIONAL SYMPOSIUM ON TECHNOLOGIES FOR HOMELAND SECURITY (HST), 2022,
  • [23] Deep Reinforcement Learning for Sponsored Search Real-time Bidding
    Zhao, Jun
    Qiu, Guang
    Guan, Ziyu
    Zhao, Wei
    He, Xiaofei
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1021 - 1030
  • [24] Robustness challenges in Reinforcement Learning based time-critical cloud resource scheduling: A Meta-Learning based solution
    Liu, Hongyun
    Chen, Peng
    Ouyang, Xue
    Gao, Hui
    Yan, Bing
    Grosso, Paola
    Zhao, Zhiming
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 146 : 18 - 33
  • [25] Learning Relevant Questions for Conversational Product Search using Deep Reinforcement Learning
    Montazeralghaem, Ali
    Allan, James
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 746 - 754
  • [26] Search and Rescue Using Multiple Drones in Post-Disaster Situation
    Cui, Jin Q.
    Phang, Swee King
    Ang, Kevin Z. Y.
    Wang, Fei
    Dong, Xiangxu
    Ke, Yijie
    Lai, Shupeng
    Li, Kun
    Li, Xiang
    Lin, Jing
    Liu, Peidong
    Pang, Tao
    Wang, Kangli
    Yang, Zhaolin
    Lin, Feng
    Chen, Ben M.
    UNMANNED SYSTEMS, 2016, 4 (01) : 83 - 96
  • [27] Learning Time-Critical Responses for Interactive Character Control
    Lee, Kyungho
    Min, Sehee
    Lee, Sunmin
    Lee, Jehee
    ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (04):
  • [28] Using Swarm Intelligence to Coordinate a Fleet of Drones in a Search and Rescue Mission
    Pham, Trung T.
    Krishen, Kumar
    Marine, Larry
    2022 INTERNATIONAL SYMPOSIUM ON MEASUREMENT AND CONTROL IN ROBOTICS (ISMCR), 2022, : 90 - 97
  • [29] Improving Drone Imagery For Computer Vision/Machine Learning in Wilderness Search and Rescue
    Murphy, Robin
    Manzini, Thomas
    2023 IEEE INTERNATIONAL SYMPOSIUM ON SAFETY, SECURITY, AND RESCUE ROBOTICS, SSRR, 2023, : 159 - 164
  • [30] Aerial filming with synchronized drones using reinforcement learning
    Kenneth C. W Goh
    Raymond B. C Ng
    Yoke-Keong Wong
    Nicholas J. H Ho
    Matthew C. H Chua
    Multimedia Tools and Applications, 2021, 80 : 18125 - 18150