Maximum Information Coverage and Monitoring Path Planning with Unmanned Surface Vehicles Using Deep Reinforcement Learning

被引:0
|
作者
Yanes Luis, Samuel [1 ]
Gutierrez Reina, Daniel [1 ]
Toral, Sergio [1 ]
机构
[1] Univ Seville, Seville, Spain
来源
关键词
Deep reinforcement learning; Informative path planning; Autonomous surface vehicles; WATER-RESOURCES;
D O I
10.1007/978-3-031-22039-5_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Manual monitoring large water reservoirs is a complex and high-cost task that requires many human resources. By using Autonomous Surface Vehicles, informative missions for modeling and supervising can be performed efficiently. Given a model of the uncertainty of the measurements, the minimization of entropy is proven to be a suitable criterion to find a surrogate model of the contamination map, also with complete coverage pathplanning. This work uses Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to find a suitable policy that solves this maximum information coverage path planning, whereas the obstacles are avoided. The results show that the proposed framework outperforms other methods in the literature by 32% in entropy minimization and by 63% in model accuracy.
引用
收藏
页码:13 / 24
页数:12
相关论文
共 50 条
  • [31] Coverage Path Planning With Budget Constraints for Multiple Unmanned Ground Vehicles
    Tran, Vu Phi
    Perera, Asanka
    Garratt, Matthew A.
    Kasmarik, Kathryn
    Anavatti, Sreenatha G.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) : 12506 - 12522
  • [32] Evaluation and Enhancement of Resolution-Aware Coverage Path Planning Method for Surface Inspection Using Unmanned Aerial Vehicles
    Wu, Weitong
    Funabora, Yuki
    Doki, Shinji
    Doki, Kae
    Yoshikawa, Satoru
    Mitsuda, Tetsuji
    Xiang, Jingyu
    IEEE ACCESS, 2024, 12 : 16753 - 16766
  • [33] An Intelligent Path Planning Scheme of Autonomous Vehicles Platoon Using Deep Reinforcement Learning on Network Edge
    Chen, Chen
    Jiang, Jiange
    Lv, Ning
    Li, Siyu
    IEEE ACCESS, 2020, 8 : 99059 - 99069
  • [34] An Intelligent Path Planning Scheme of Autonomous Vehicles Platoon Using Deep Reinforcement Learning on Network Edge
    Chen, Chen
    Jiang, Jiange
    Lv, Ning
    Li, Siyu
    IEEE Access, 2020, 8 : 99059 - 99069
  • [35] A Multiagent Deep Reinforcement Learning Approach for Path Planning in Autonomous Surface Vehicles: The Ypacarai Lake Patrolling Case
    Luis, Samuel Yanes
    Reina, Daniel Gutierrez
    Marin, Sergio L. Toral
    IEEE ACCESS, 2021, 9 : 17084 - 17099
  • [36] Towards a Deep Reinforcement Learning Solution to the Coverage Path Planning Problem<bold> </bold>
    Abdelaziz, Shaza I. Kaoud
    Noureldin, Aboelmagd
    Givigi, Sidney
    2024 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE 2024, 2024, : 152 - 153
  • [37] Data-based deep reinforcement learning and active FTC for unmanned surface vehicles
    Fan, Zhenyao
    Wang, Lipeng
    Meng, Hao
    Yang, Chunsheng
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (11):
  • [38] Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning
    Hu, Hui
    Wang, Yuge
    Tong, Wenjie
    Zhao, Jiao
    Gu, Yulei
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [39] Flocking of Under-Actuated Unmanned Surface Vehicles via Deep Reinforcement Learning and Model Predictive Path Integral Control
    Pan, Chao
    Peng, Zhouhua
    Li, Yongming
    Han, Bing
    Wang, Dan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 11
  • [40] Deep reinforcement learning-based controller for path following of an unmanned surface vehicle
    Woo, Joohyun
    Yu, Chanwoo
    Kim, Nakwan
    OCEAN ENGINEERING, 2019, 183 : 155 - 166