Maximum Information Coverage and Monitoring Path Planning with Unmanned Surface Vehicles Using Deep Reinforcement Learning

被引:0
|
作者
Yanes Luis, Samuel [1 ]
Gutierrez Reina, Daniel [1 ]
Toral, Sergio [1 ]
机构
[1] Univ Seville, Seville, Spain
来源
关键词
Deep reinforcement learning; Informative path planning; Autonomous surface vehicles; WATER-RESOURCES;
D O I
10.1007/978-3-031-22039-5_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Manual monitoring large water reservoirs is a complex and high-cost task that requires many human resources. By using Autonomous Surface Vehicles, informative missions for modeling and supervising can be performed efficiently. Given a model of the uncertainty of the measurements, the minimization of entropy is proven to be a suitable criterion to find a surrogate model of the contamination map, also with complete coverage pathplanning. This work uses Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to find a suitable policy that solves this maximum information coverage path planning, whereas the obstacles are avoided. The results show that the proposed framework outperforms other methods in the literature by 32% in entropy minimization and by 63% in model accuracy.
引用
收藏
页码:13 / 24
页数:12
相关论文
共 50 条
  • [21] Unmanned Aerial Vehicles Path Planning for Area Monitoring
    Khoufi, Ines
    Minet, Pascale
    Achir, Nadjib
    5TH IFIP INTERNATIONAL CONFERENCE ON PERFORMANCE EVALUATION AND MODELING IN WIRED AND WIRELESS NETWORKS PEMWN 16, 2016,
  • [22] UAV Path Planning using Global and Local Map Information with Deep Reinforcement Learning
    Theile, Mirco
    Bayerlein, Harald
    Nai, Richard
    Gesbert, David
    Caccamo, Marco
    2021 20TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2021, : 539 - 546
  • [23] Coverage path planning for kiwifruit picking robots based on deep reinforcement learning
    Wang, Yinchu
    He, Zhi
    Cao, Dandan
    Ma, Li
    Li, Kai
    Jia, Liangsheng
    Cui, Yongjie
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 205
  • [24] Multi-Agent Coverage Path Planning using a Swarm of Unmanned Aerial Vehicles
    Chethan, Ragala
    Kar, Indrani
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [25] Image Processing and Model-Based Spill Coverage Path Planning for Unmanned Surface Vehicles
    Luo, Shaocheng
    Singh, Yogang
    Yang, Hanyao
    Bae, Jun Han
    Dietzt, J. Eric
    Diao, Xiumin
    Min, Byung-Cheol
    OCEANS 2019 MTS/IEEE SEATTLE, 2019,
  • [26] Advanced planning for autonomous vehicles using reinforcement learning and deep inverse reinforcement learning
    You, Changxi
    Lu, Jianbo
    Filev, Dimitar
    Tsiotras, Panagiotis
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2019, 114 : 1 - 18
  • [27] Coverage path planning for maritime search and rescue using reinforcement learning
    Ai, Bo
    Jia, Maoxin
    Xu, Hanwen
    Xu, Jiangling
    Wen, Zhen
    Li, Benshuai
    Zhang, Dan
    OCEAN ENGINEERING, 2021, 241
  • [28] Path planning on satellite images for unmanned surface vehicles
    Yang, Joe-Ming
    Tseng, Chien-Ming
    Tseng, P. S.
    INTERNATIONAL JOURNAL OF NAVAL ARCHITECTURE AND OCEAN ENGINEERING, 2015, 7 (01) : 87 - 99
  • [29] Collaborative Path Planning based on MAXQ Hierarchical Reinforcement Learning for Manned/Unmanned Aerial Vehicles
    Yan, Yongjie
    Wang, Hongjie
    Chen, Xianfeng
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 4837 - 4842
  • [30] Towards Using Reinforcement Learning for Autonomous Docking of Unmanned Surface Vehicles
    Holen, Martin
    Ruud, Else-Line Malene
    Warakagoda, Narada Dilp
    Goodwin, Morten
    Engelstad, Paal
    Knausgard, Kristian Muri
    ENGINEERING APPLICATIONS OF NEURAL NETWORKS, EAAAI/EANN 2022, 2022, 1600 : 461 - 474