A NOVEL PATH PLANNING FOR AUV BASED ON DUNG BEETLE OPTIMISATION ALGORITHM WITH DEEP Q-NETWORK

被引:0
|
作者
Li, Baogang [1 ]
Zhang, Hanbin [2 ]
Shi, Xianpeng [3 ]
机构
[1] Shanghai Maritime Univ, Shanghai, Peoples R China
[2] Ocean Univ China, Qingdao, Peoples R China
[3] Minist Nat Resources Peoples Republ China, Natl Deep Sea Ctr, Qingdao, Peoples R China
来源
关键词
Autonomous underwater vehicles; dung beetle optimisation; deep Q-network; path planning;
D O I
10.2316/J.2025.206-1098
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study presents a route planning technique, known as dung beetle optimisation with deep Q-network (DBO-DQN), to tackle the difficulties associated with quick path planning and efficient obstacle avoidance for autonomous underwater vehicles (AUVs) operating in a 3D underwater environment. A reinforcement learning approach has been devised to enhance the convergence of DBO. The proposed approach involves substituting the uniformly distributed random number in the updating function with a randomly generated number drawn from a specific normal distribution. The estimation of the mean and standard deviation of the normal distribution is achieved by utilising the present state of each person through the DQN algorithm. The utilisation of the piecewise logistic chaotic mapping initialises the population with the objective of enhancing the variety of the population. In conclusion, taking into account the unique characteristics of the underwater environment, a fitness function is formulated that incorporates both the length of the route path and the deflection angle. This enables the algorithm to identify a solution path that minimises energy usage in the underwater environment. The efficacy of the suggested strategy in comparison to conventional methods is proven by both simulation and experimental findings.
引用
收藏
页码:65 / 73
页数:9
相关论文
共 50 条
  • [21] UAV Trajectory Planning Based on Deep Q-Network for Internet of Things
    Zhang Jianhang
    Kang Kai
    Qian Hua
    Yang Miao
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (11) : 3850 - 3857
  • [22] Improved Double Deep Q-Network Algorithm Applied to Multi-Dimensional Environment Path Planning of Hexapod Robots
    Chen, Liuhongxu
    Wang, Qibiao
    Deng, Chao
    Xie, Bo
    Tuo, Xianguo
    Jiang, Gang
    SENSORS, 2024, 24 (07)
  • [23] UAV path planning based on improved dung beetle algorithm with multiple strategy integration
    Chang, Baoshuai
    Xi, Wanqiang
    Lin, Junzhi
    Shao, Ziyan
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2025, 239 (03) : 223 - 240
  • [24] Three-dimensional path planning of UAV based on improved dung beetle algorithm
    Liu, Congjian
    Bian, Jinxin
    Zheng, Xiaojun
    Li, Siyang
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 1531 - 1535
  • [25] Path Planning of Unmanned Helicopter in Complex Dynamic Environment Based on State-Coded Deep Q-Network
    Yao, Jiangyi
    Li, Xiongwei
    Zhang, Yang
    Ji, Jingyu
    Wang, Yanchao
    Liu, Yicen
    SYMMETRY-BASEL, 2022, 14 (05):
  • [26] Improvement of Dung Beetle Optimization Algorithm Application to Robot Path Planning
    Liu, Kezhen
    Dai, Yongqiang
    Liu, Huan
    APPLIED SCIENCES-BASEL, 2025, 15 (01):
  • [27] A Novel Path Planning Approach for Mobile Robot in Radioactive Environment Based on Improved Deep Q Network Algorithm
    Wu, Zhiqiang
    Yin, Yebo
    Liu, Jie
    Zhang, De
    Chen, Jie
    Jiang, Wei
    SYMMETRY-BASEL, 2023, 15 (11):
  • [28] Path Planning Method for Mobile Robot Based on Curiosity Distillation Double Q-Network
    Zhang, Feng
    Gu, Qiran
    Yuan, Shuai
    Computer Engineering and Applications, 2023, 59 (19) : 316 - 322
  • [29] AGV dispatching algorithm based on deep Q-network in CNC machines environment
    Chang, Kyuchang
    Park, Seung Hwan
    Baek, Jun-Geol
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2022, 35 (06) : 662 - 677
  • [30] Tuning Apex DQN: A Reinforcement Learning based Deep Q-Network Algorithm
    Ruhela, Dhani
    Ruhela, Amit
    PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2024, PEARC 2024, 2024,