Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation

被引:0
|
作者
Estevez, Julian [1 ]
Manuel Lopez-Guede, Jose [2 ]
del Valle-Echavarri, Javier [2 ]
Grana, Manuel [3 ]
机构
[1] Univ Basque Country UPV EHU, Fac Engn Gipuzkoa, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
[2] Univ Basque Country, Fac Engn Vitoria, Grp Computat Intelligence, Vitoria 01006, Spain
[3] Univ Basque Country, Fac Comp Sci, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Aerial robots; payload; reinforcement learning; UAVs; QUADROTOR;
D O I
10.1109/ACCESS.2024.3470509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study introduces a novel trajectory planning approach for the transportation of cable-suspended loads employing three quadrotors, relying on a reinforcement learning (RL) algorithm. The primary objective of this path planning method is to transport the cargo smoothly while avoiding its swing. Within this proposed solution, the value function of the RL is estimated through a feature vector and a parameter vector tailored to the specific problem. The parameter vector undergoes iterative updates via a batch method, subsequently guiding the generation of the desired trajectory through a greedy strategy. Ultimately, this desired trajectory is communicated to the quadrotor controller to ensure precise trajectory tracking. Simulation outcomes demonstrate the capability of the trained parameters to effectively fit the value function.
引用
收藏
页码:144009 / 144016
页数:8
相关论文
共 50 条
  • [31] Multi-UAV reconnaissance mission planning via deep reinforcement learning with simulated annealing
    Fan, Mingfeng
    Liu, Huan
    Wu, Guohua
    Gunawan, Aldy
    Sartoretti, Guillaume
    SWARM AND EVOLUTIONARY COMPUTATION, 2025, 93
  • [32] Trajectory Planning for Data Collection in Multi-UAV Assisted WSNs
    Benmad, Ilham
    Driouch, Elmahdi
    Kardouchi, Mustapha
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [33] A Study on Applying Mobility Patterns for Multi-UAV Trajectory Planning
    Vladuta, Valentin-Alexandru
    Grumazescu, Constantin
    PROCEEDINGS OF THE 2020 12TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTERS AND ARTIFICIAL INTELLIGENCE (ECAI-2020), 2020,
  • [34] Dynamic Attention Network for Multi-UAV Reinforcement Learning
    Xu, Dongsheng
    Wu, Shang
    INTERNATIONAL CONFERENCE ON ALGORITHMS, HIGH PERFORMANCE COMPUTING, AND ARTIFICIAL INTELLIGENCE (AHPCAI 2021), 2021, 12156
  • [35] Multi-UAV trajectory optimizer: A sustainable system for wireless data harvesting with deep reinforcement learning
    Seong, Mincheol
    Jo, Ohyun
    Shin, Kyungseop
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [36] Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement Learning
    Zhang, Wenqi
    Wang, Qiang
    Liu, Xiao
    Liu, Yuanwei
    Chen, Yue
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (01) : 600 - 612
  • [37] Multi-UAV Trajectory Planning for Energy-Efficient Content Coverage: A Decentralized Learning-Based Approach
    Zhao, Chenxi
    Liu, Junyu
    Sheng, Min
    Teng, Wei
    Zheng, Yang
    Li, Jiandong
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (10) : 3193 - 3207
  • [38] Multi-UAV Cooperative Trajectory Planning Based on Many-Objective Evolutionary Algorithm
    Bai H.
    Fan T.
    Niu Y.
    Cui Z.
    Complex System Modeling and Simulation, 2022, 2 (02): : 130 - 141
  • [39] Multi-UAV Cooperative Trajectory Planning Based on FDS-ADEA in Complex Environments
    Huang, Gang
    Hu, Min
    Yang, Xueying
    Lin, Peng
    DRONES, 2023, 7 (01)
  • [40] Reinforcement Learning based Approach for Multi-UAV Cooperative Searching in Unknown Environments
    Yue, Wei
    Guan, Xianhe
    Xi, Yun
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2018 - 2023