Maximum Information Coverage and Monitoring Path Planning with Unmanned Surface Vehicles Using Deep Reinforcement Learning

被引:0
|
作者
Yanes Luis, Samuel [1 ]
Gutierrez Reina, Daniel [1 ]
Toral, Sergio [1 ]
机构
[1] Univ Seville, Seville, Spain
来源
关键词
Deep reinforcement learning; Informative path planning; Autonomous surface vehicles; WATER-RESOURCES;
D O I
10.1007/978-3-031-22039-5_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Manual monitoring large water reservoirs is a complex and high-cost task that requires many human resources. By using Autonomous Surface Vehicles, informative missions for modeling and supervising can be performed efficiently. Given a model of the uncertainty of the measurements, the minimization of entropy is proven to be a suitable criterion to find a surrogate model of the contamination map, also with complete coverage pathplanning. This work uses Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to find a suitable policy that solves this maximum information coverage path planning, whereas the obstacles are avoided. The results show that the proposed framework outperforms other methods in the literature by 32% in entropy minimization and by 63% in model accuracy.
引用
收藏
页码:13 / 24
页数:12
相关论文
共 50 条
  • [41] Path planning for cooperative sensing using unmanned vehicles
    Tisdale, John
    Durrant-Whyte, Hugh
    Hedrick, J. Karl
    PROCEEDINGS OF THE ASME INTERNATIONAL MECHANICAL ENGINERING CONGRESS AND EXPOSITION 2007, VOL 9, PTS A-C: MECHANICAL SYSTEMS AND CONTROL, 2008, : 715 - 723
  • [42] Unmanned Aerial Vehicle Path Planning in Complex Dynamic Environments Based on Deep Reinforcement Learning
    Liu, Jiandong
    Luo, Wei
    Zhang, Guoqing
    Li, Ruihao
    MACHINES, 2025, 13 (02)
  • [43] Risk-Aware Complete Coverage Path Planning Using Reinforcement Learning
    Wijegunawardana, I. D.
    Samarakoon, S. M. Bhagya P.
    Muthugala, M. A. Viraj J.
    Elara, Mohan Rajesh
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025, 55 (04): : 2476 - 2488
  • [44] Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning
    Qian, Yubin
    Feng, Song
    Hu, Wenhao
    Wang, Wanqiu
    ADVANCES IN MECHANICAL ENGINEERING, 2022, 14 (12)
  • [45] Cooperative Search Path Planning for Multiple Unmanned Surface Vehicles
    Zhao, Pengcheng
    Li, Jinming
    Mao, Zhaoyong
    Ding, Wenjun
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 3434 - 3445
  • [46] Online Path Planning Based on MILP for Unmanned Surface Vehicles
    Leng, Jing
    Liu, Jian
    Xu, Hongli
    2013 OCEANS - SAN DIEGO, 2013,
  • [47] Deep Reinforcement Learning for Mapless Navigation of Unmanned Aerial Vehicles
    Grando, Ricardo B.
    de Jesus, Junior C.
    Drews-Jr, Paulo L. J.
    2020 XVIII LATIN AMERICAN ROBOTICS SYMPOSIUM, 2020 XII BRAZILIAN SYMPOSIUM ON ROBOTICS AND 2020 XI WORKSHOP OF ROBOTICS IN EDUCATION (LARS-SBR-WRE 2020), 2020, : 335 - 340
  • [48] Collision avoidance for an unmanned surface vehicle using deep reinforcement learning
    Woo, Joohyun
    Kim, Nakwan
    OCEAN ENGINEERING, 2020, 199
  • [49] Balanced Multi-Region Coverage Path Planning for Unmanned Aerial Vehicles
    Yu, Xiaoxiao
    Jin, Songchang
    Shi, Dianxi
    Li, Lin
    Kang, Ying
    Zou, Junbo
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3499 - 3506
  • [50] Mobile Service Robot Path Planning Using Deep Reinforcement Learning
    Kumaar, A. A. Nippun
    Kochuvila, Sreeja
    IEEE ACCESS, 2023, 11 : 100083 - 100096