USVs Path Planning for Maritime Search and Rescue Based on POS-DQN: Probability of Success-Deep Q-Network

被引:0
|
作者
Liu, Lu [1 ]
Shan, Qihe [1 ]
Xu, Qi [2 ]
机构
[1] Dalian Maritime Univ, Nav Coll, Dalian 116026, Peoples R China
[2] Zhejiang Lab, Res Inst Intelligent Networks, Hangzhou 311121, Peoples R China
基金
中国国家自然科学基金;
关键词
SAR; task allocation; deep reinforcement learning;
D O I
10.3390/jmse12071158
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Efficient maritime search and rescue (SAR) is crucial for responding to maritime emergencies. In traditional SAR, fixed search path planning is inefficient and cannot prioritize high-probability regions, which has significant limitations. To solve the above problems, this paper proposes unmanned surface vehicles (USVs) path planning for maritime SAR based on POS-DQN so that USVs can perform SAR tasks reasonably and efficiently. Firstly, the search region is allocated as a whole using an improved task allocation algorithm so that the task region of each USV has priority and no duplication. Secondly, this paper considers the probability of success (POS) of the search environment and proposes a POS-DQN algorithm based on deep reinforcement learning. This algorithm can adapt to the complex and changing environment of SAR. It designs a probability weight reward function and trains USV agents to obtain the optimal search path. Finally, based on the simulation results, by considering the complete coverage of obstacle avoidance and collision avoidance, the search path using this algorithm can prioritize high-probability regions and improve the efficiency of SAR.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] 3D Aerial Base Station Position Planning based on Deep Q-Network for Capacity Enhancement
    Wu, Jiahui
    Yu, Peng
    Feng, Lei
    Zhou, Fanqin
    Li, Wenjing
    Qiu, Xuesong
    2019 IFIP/IEEE SYMPOSIUM ON INTEGRATED NETWORK AND SERVICE MANAGEMENT (IM), 2019, : 482 - 487
  • [42] UAV path planning algorithm based on Deep Q-Learning to search for a lost in the ocean
    Boulares, Mehrez
    Fehri, Afef
    Jemni, Mohamed
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2024, 179
  • [43] A Stealth-Distance Dynamic Weight Deep Q-Network Algorithm for Three-Dimensional Path Planning of Unmanned Aerial Helicopter
    Wang, Zeyang
    Huang, Jun
    Yi, Mingxu
    AEROSPACE, 2023, 10 (08)
  • [44] A reinforcement learning-based evolutionary algorithm for the unmanned aerial vehicles maritime search and rescue path planning problem considering multiple rescue centers
    Zhan, Haowen
    Zhang, Yue
    Huang, Jingbo
    Song, Yanjie
    Xing, Lining
    Wu, Jie
    Gao, Zengyun
    MEMETIC COMPUTING, 2024, 16 (03) : 373 - 386
  • [45] AUV 3D Path Planning Based on the Improved Hierarchical Deep Q Network
    Sun, Yushan
    Ran, Xiangrui
    Zhang, Guocheng
    Xu, Hao
    Wang, Xiangbin
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2020, 8 (02)
  • [46] Improving Deep Q Network Based on Marketing Psychology for AUV Path Planning in Unknown Marine Environments
    Liu, Zhilei
    Hou, Jiaoyi
    Ning, Dayong
    Zhou, Cheng
    Liang, Gangda
    Zhang, Fengrui
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (05): : 5476 - 5487
  • [47] CSO-DQN: Circle Search Optimization-based Deep Q-Learning Network for Intrusion Detection System in Cloud Environment
    Pravin, Albert
    Jacob, T. Prem
    Kumar, R. Raja
    IETE JOURNAL OF RESEARCH, 2024, 70 (09) : 7469 - 7483
  • [48] A Novel Path Planning Approach for Mobile Robot in Radioactive Environment Based on Improved Deep Q Network Algorithm
    Wu, Zhiqiang
    Yin, Yebo
    Liu, Jie
    Zhang, De
    Chen, Jie
    Jiang, Wei
    SYMMETRY-BASEL, 2023, 15 (11):
  • [49] Improved Double Deep Q Network Algorithm Based on Average Q-Value Estimation and Reward Redistribution for Robot Path Planning
    Yin, Yameng
    Zhang, Lieping
    Shi, Xiaoxu
    Wang, Yilin
    Peng, Jiansheng
    Zou, Jianchu
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (02): : 2769 - 2790
  • [50] Deep Q-Network-Based Hierarchical Path Planning of a Biped Wall-Climbing Robot for Window Cleaning
    Zhang, Weijian
    Li, Zikang
    Tam, Lap Mou
    Xu, Qingsong
    ADVANCED INTELLIGENT SYSTEMS, 2025,