Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation

被引:0
|
作者
Estevez, Julian [1 ]
Manuel Lopez-Guede, Jose [2 ]
del Valle-Echavarri, Javier [2 ]
Grana, Manuel [3 ]
机构
[1] Univ Basque Country UPV EHU, Fac Engn Gipuzkoa, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
[2] Univ Basque Country, Fac Engn Vitoria, Grp Computat Intelligence, Vitoria 01006, Spain
[3] Univ Basque Country, Fac Comp Sci, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Aerial robots; payload; reinforcement learning; UAVs; QUADROTOR;
D O I
10.1109/ACCESS.2024.3470509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study introduces a novel trajectory planning approach for the transportation of cable-suspended loads employing three quadrotors, relying on a reinforcement learning (RL) algorithm. The primary objective of this path planning method is to transport the cargo smoothly while avoiding its swing. Within this proposed solution, the value function of the RL is estimated through a feature vector and a parameter vector tailored to the specific problem. The parameter vector undergoes iterative updates via a batch method, subsequently guiding the generation of the desired trajectory through a greedy strategy. Ultimately, this desired trajectory is communicated to the quadrotor controller to ensure precise trajectory tracking. Simulation outcomes demonstrate the capability of the trained parameters to effectively fit the value function.
引用
收藏
页码:144009 / 144016
页数:8
相关论文
共 50 条
  • [41] Optimal formation tracking control based on reinforcement learning for multi-UAV systems
    Wang, Weizhen
    Chen, Xin
    Jia, Jiangbo
    Wu, Kaili
    Xie, Mingyang
    CONTROL ENGINEERING PRACTICE, 2023, 141
  • [42] Transformer-Based Reinforcement Learning for Scalable Multi-UAV Area Coverage
    Chen, Dezhi
    Qi, Qi
    Fu, Qianlong
    Wang, Jingyu
    Liao, Jianxin
    Han, Zhu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 10062 - 10077
  • [43] Multiagent Reinforcement Learning in Controlling Offloading Ratio and Trajectory for Multi-UAV Mobile-Edge Computing
    Lee, Wonseok
    Kim, Taejoon
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02) : 3417 - 3429
  • [44] Low AoI Multi-UAV IoT Task Allocation and Trajectory Planning
    Zhou, Zixuan
    Li, Xinkai
    Zhang, Hongli
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (05): : 66 - 72
  • [45] Integrated Solution Method for Multi-UAV Task Assignment and Trajectory Planning
    Xu J.
    Wu W.
    Gong C.
    Yuhang Xuebao/Journal of Astronautics, 2023, 44 (12): : 1860 - 1870
  • [46] Multi-UAV Dynamic Wireless Networking With Deep Reinforcement Learning
    Wang, Qiang
    Zhang, Wenqi
    Liu, Yuanwei
    Liu, Ying
    IEEE COMMUNICATIONS LETTERS, 2019, 23 (12) : 2243 - 2246
  • [47] Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning
    Isufaj, Ralvi
    Omeri, Marsel
    Piera, Miquel Angel
    APPLIED SCIENCES-BASEL, 2022, 12 (02):
  • [48] Deep reinforcement learning based trajectory design and resource allocation for task-aware multi-UAV enabled MEC networks
    Li, Zewu
    Xu, Chen
    Zhang, Zhanpeng
    Wu, Runze
    COMPUTER COMMUNICATIONS, 2024, 213 : 88 - 98
  • [49] Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments
    Kong, Xiaoran
    Zhou, Yatong
    Li, Zhe
    Wang, Shaohai
    FRONTIERS IN NEUROROBOTICS, 2024, 17
  • [50] Q-Learning-based Multi-UAV Cooperative Path Planning Method
    Yin Y.
    Wang X.
    Zhou J.
    Binggong Xuebao/Acta Armamentarii, 2023, 44 (02): : 484 - 495