Research on Dynamic Path Planning Algorithm for Unmanned Underwater Vehicles Based on Multi-step Mechanism DDQN

被引：0
|
作者：
Wang, Zheng [1 ]
Qu, Xinyu [1 ]
Yin, Yang [1 ]
Li, Houpu [1 ]
机构：
[1] Naval Univ Engn, Sch Elect Engn, Wuhan 430033, Peoples R China
来源：
BIO-INSPIRED COMPUTING: THEORIES AND APPLICATIONS, PT 2, BIC-TA 2023 | 2024年 / 2062卷
关键词：
Dynamic path planning; DDQN; Q(lambda);
D O I：
10.1007/978-981-97-2275-4_32
中图分类号：
TP39 [计算机的应用];
学科分类号：
081203 ; 0835 ;
摘要：
The dynamic path planning capability of UUV in complex underwater environment is difficult to meet the needs of advanced nature. In this paper, Q(lambda) algorithm and DDQN algorithm are combined, the updated iteration strategy of DDQN algorithm is improved, and a MS-DDQN algorithm is designed to obtain more accurate Q value through continuous multi-step interaction and instant reward. According to this algorithm, the input information and reward function of the algorithm are redesigned, and the UUV path planning is divided into two network modules: navigation and obstacle avoidance, which improves the dynamic path planning ability of UUV. The simulation results show that the MS-DDQN algorithm has a high planning success rate and can meet the dynamic operation requirements of UUV.
引用
收藏
页码：409 / 417
页数：9
相关论文
共 50 条
  • [21] Multi-step Reinforcement Learning Algorithm of Mobile Robot Path Planning Based on Virtual Potential Field
    Liu, Jun
    Qi, Wei
    Lu, Xu
    DATA SCIENCE, PT II, 2017, 728 : 528 - 538
  • [22] An Algorithm for Path Planning of Multiple Unmanned Aerial Vehicles Based on Bezier Curve
    Hu Feng
    Wang Shuo
    PROCEEDINGS OF THE 29TH CHINESE CONTROL CONFERENCE, 2010, : 3660 - 3665
  • [23] Path planning of unmanned vehicles based on adaptive particle swarm optimization algorithm
    Zhao, Jiale
    Deng, Chaoshuo
    Yu, Huanhuan
    Fei, Hansheng
    Li, Deshun
    COMPUTER COMMUNICATIONS, 2024, 216 : 112 - 129
  • [24] Path Planning Method of Unmanned Surface Vehicles Formation Based on Improved A* Algorithm
    Sang, Tongtong
    Xiao, Jinchao
    Xiong, Junfeng
    Xia, Haoyun
    Wang, Zhongze
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (01)
  • [25] Research on Three-dimensional Path Planning for Autonomous Underwater Vehicles Based on Multi Objective Decision
    Pan, Xin
    Wu, Xusheng
    Hou, Xinguo
    Feng, Yuan
    2017 4TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE), 2017, : 644 - 650
  • [26] Parallel Algorithm for the Path Planning of Multiple Unmanned Aerial Vehicles
    Roberge, Vincent
    Tarbouchi, Mohammed
    2020 FOURTH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING IN DATA SCIENCES (ICDS), 2020,
  • [27] Three-Dimensional Path Planning for Unmanned Aerial Vehicles Based on Multi-objective Genetic Algorithm
    Tao, Hongtao
    Wang, Zheng
    Li, Jianxun
    2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 8617 - 8621
  • [28] An Improved Genetic Algorithm for Optimal Search Path of Unmanned Underwater Vehicles
    Mao, Zhaoyong
    Liu, Peiliang
    Ding, Wenjun
    Hui, Guo
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT II, 2019, 11741 : 480 - 488
  • [29] Global Path Planning Algorithm for Unmanned Vehicles Based on Multi-Objective Particle Swarm Optimization Strategy
    Xie, Jun
    Jiang, Qing
    Wang, Yuxiao
    Zhang, Yifan
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (08)
  • [30] An adaptive path planning algorithm for cooperating unmanned air vehicles
    Cunningham, CT
    Roberts, RS
    2001 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS I-IV, PROCEEDINGS, 2001, : 3981 - 3986
12345