Maximum Information Coverage and Monitoring Path Planning with Unmanned Surface Vehicles Using Deep Reinforcement Learning

被引:0
|
作者
Yanes Luis, Samuel [1 ]
Gutierrez Reina, Daniel [1 ]
Toral, Sergio [1 ]
机构
[1] Univ Seville, Seville, Spain
来源
关键词
Deep reinforcement learning; Informative path planning; Autonomous surface vehicles; WATER-RESOURCES;
D O I
10.1007/978-3-031-22039-5_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Manual monitoring large water reservoirs is a complex and high-cost task that requires many human resources. By using Autonomous Surface Vehicles, informative missions for modeling and supervising can be performed efficiently. Given a model of the uncertainty of the measurements, the minimization of entropy is proven to be a suitable criterion to find a surrogate model of the contamination map, also with complete coverage pathplanning. This work uses Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to find a suitable policy that solves this maximum information coverage path planning, whereas the obstacles are avoided. The results show that the proposed framework outperforms other methods in the literature by 32% in entropy minimization and by 63% in model accuracy.
引用
收藏
页码:13 / 24
页数:12
相关论文
共 50 条
  • [1] Learn to Navigate: Cooperative Path Planning for Unmanned Surface Vehicles Using Deep Reinforcement Learning
    Zhou, Xinyuan
    Wu, Peng
    Zhang, Haifeng
    Guo, Weihong
    Liu, Yuanchang
    IEEE ACCESS, 2019, 7 : 165262 - 165278
  • [2] Pursuit Path Planning for Multiple Unmanned Ground Vehicles Based on Deep Reinforcement Learning
    Guo, Hongda
    Xu, Youchun
    Ma, Yulin
    Xu, Shucai
    Li, Zhixiong
    ELECTRONICS, 2023, 12 (23)
  • [3] An Algorithm of Complete Coverage Path Planning for Unmanned Surface Vehicle Based on Reinforcement Learning
    Xing, Bowen
    Wang, Xiao
    Yang, Liu
    Liu, Zhenchong
    Wu, Qingyun
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (03)
  • [4] A coverage path planning approach for environmental monitoring using an unmanned surface vehicle
    Ramkumar Sudha S.K.
    Mishra D.
    Hameed I.A.
    Ocean Engineering, 2024, 310
  • [5] Global path planning for amphibious unmanned vehicles with multiple constraints via deep reinforcement learning
    Wu, Ting
    Wang, Ronghao
    Zhang, Yan
    Meng, Yuhang
    Xiang, Yuzhu
    Xiang, Zhengrong
    2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 1296 - 1301
  • [6] Path Planning for Underactuated Unmanned Surface Vehicle Swarm Based on Deep Reinforcement Learning
    Hou, Yuli
    Wang, Ning
    Qiu, Chidong
    PROCEEDINGS OF THE 36TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC 2024, 2024, : 409 - 414
  • [7] Coverage Path Planning Using Actor-Critic Deep Reinforcement Learning
    Garrido-Castaneda, Sergio Isahi
    Vasquez, Juan Irving
    Antonio-Cruz, Mayra
    SENSORS, 2025, 25 (05)
  • [8] Intelligent controller for unmanned surface vehicles by deep reinforcement learning
    Lai, Pengyu
    Liu, Yi
    Zhang, Wei
    Xu, Hui
    PHYSICS OF FLUIDS, 2023, 35 (03)
  • [9] Cooperative Path Planning of Multiple Unmanned Surface Vehicles for Search and Coverage Task
    Zhao, Zhiyao
    Zhu, Bin
    Zhou, Yan
    Yao, Peng
    Yu, Jiabin
    DRONES, 2023, 7 (01)
  • [10] Survey on Coverage Path Planning with Unmanned Aerial Vehicles
    Cabreira, Taua M.
    Brisolara, Lisane B.
    Paulo R., Ferreira Jr.
    DRONES, 2019, 3 (01) : 1 - 38