A NOVEL PATH PLANNING FOR AUV BASED ON DUNG BEETLE OPTIMISATION ALGORITHM WITH DEEP Q-NETWORK

被引:0
|
作者
Li, Baogang [1 ]
Zhang, Hanbin [2 ]
Shi, Xianpeng [3 ]
机构
[1] Shanghai Maritime Univ, Shanghai, Peoples R China
[2] Ocean Univ China, Qingdao, Peoples R China
[3] Minist Nat Resources Peoples Republ China, Natl Deep Sea Ctr, Qingdao, Peoples R China
来源
关键词
Autonomous underwater vehicles; dung beetle optimisation; deep Q-network; path planning;
D O I
10.2316/J.2025.206-1098
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study presents a route planning technique, known as dung beetle optimisation with deep Q-network (DBO-DQN), to tackle the difficulties associated with quick path planning and efficient obstacle avoidance for autonomous underwater vehicles (AUVs) operating in a 3D underwater environment. A reinforcement learning approach has been devised to enhance the convergence of DBO. The proposed approach involves substituting the uniformly distributed random number in the updating function with a randomly generated number drawn from a specific normal distribution. The estimation of the mean and standard deviation of the normal distribution is achieved by utilising the present state of each person through the DQN algorithm. The utilisation of the piecewise logistic chaotic mapping initialises the population with the objective of enhancing the variety of the population. In conclusion, taking into account the unique characteristics of the underwater environment, a fitness function is formulated that incorporates both the length of the route path and the deflection angle. This enables the algorithm to identify a solution path that minimises energy usage in the underwater environment. The efficacy of the suggested strategy in comparison to conventional methods is proven by both simulation and experimental findings.
引用
收藏
页码:65 / 73
页数:9
相关论文
共 50 条
  • [31] The optimal dispatching strategy of cogeneration based on Deep Q-Network (DQN) algorithm
    Zhang, Pei
    Fu, Yan
    Yao, Fu
    SCIENCE AND TECHNOLOGY FOR ENERGY TRANSITION, 2024, 79
  • [32] WPT-enabled Multi-UAV Path Planning for Disaster Management Deep Q-Network
    Merabet, Adel
    Lakas, Abderrahmane
    Belkacem, Abdelkader Nasreddine
    2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 1672 - 1678
  • [33] A Stealth-Distance Dynamic Weight Deep Q-Network Algorithm for Three-Dimensional Path Planning of Unmanned Aerial Helicopter
    Wang, Zeyang
    Huang, Jun
    Yi, Mingxu
    AEROSPACE, 2023, 10 (08)
  • [34] A Full-Coverage Path Planning Method for an Orchard Mower Based on the Dung Beetle Optimization Algorithm
    Liu, Lixing
    Wang, Xu
    Liu, Hongjie
    Li, Jianping
    Wang, Pengfei
    Yang, Xin
    AGRICULTURE-BASEL, 2024, 14 (06):
  • [35] USVs Path Planning for Maritime Search and Rescue Based on POS-DQN: Probability of Success-Deep Q-Network
    Liu, Lu
    Shan, Qihe
    Xu, Qi
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (07)
  • [36] A NOVEL PATH PLANNING ALGORITHM OF AUV WITH MODEL PREDICTIVE CONTROL
    Liu, Zhaoyang
    Zhu, Daqi
    Liu, Chenxia
    Yang, Simon X.
    INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2022, 37 (06): : 460 - 467
  • [37] Quantum-Based Deep Q-Network Bandwidth Resource Allocation Algorithm for UASN
    Gao, Jia
    Wang, Jingjing
    Gu, Jianlei
    Shi, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (24): : 39932 - 39940
  • [38] Reinforced Event-Driven Evolutionary Algorithm Based on Double Deep Q-network
    Zhou, Tianwei
    Zhang, Wenwen
    Lu, Junrui
    He, Pengcheng
    Yao, Keqin
    ADVANCES IN SWARM INTELLIGENCE, ICSI 2022, PT I, 2022, : 294 - 304
  • [39] Manufacturing Resource Scheduling Based on Deep Q-Network
    ZHANG Yufei
    ZOU Yuanhao
    ZHAO Xiaodong
    Wuhan University Journal of Natural Sciences, 2022, 27 (06) : 531 - 538
  • [40] Droplet Routing Based on Double Deep Q-Network Algorithm for Digital Microfluidic Biochips
    Rajesh, Kolluri
    Pyne, Sumanta
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (17)