Multi-UAV Redeployment Optimization Based on Multi-Agent Deep Reinforcement Learning Oriented to Swarm Performance Restoration

被引:1
|
作者
Wu, Qilong [1 ]
Geng, Zitao [1 ]
Ren, Yi [1 ]
Feng, Qiang [1 ]
Zhong, Jilong [2 ]
机构
[1] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
[2] Def Innovat Inst, Acad Mil Sci, Beijing 100071, Peoples R China
基金
中国国家自然科学基金;
关键词
distributed reconfiguration strategy; multi-agent deep reinforcement learning; unmanned aerial vehicle (UAV); UAV swarm redeployment; COVERAGE;
D O I
10.3390/s23239484
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Distributed artificial intelligence is increasingly being applied to multiple unmanned aerial vehicles (multi-UAVs). This poses challenges to the distributed reconfiguration (DR) required for the optimal redeployment of multi-UAVs in the event of vehicle destruction. This paper presents a multi-agent deep reinforcement learning-based DR strategy (DRS) that optimizes the multi-UAV group redeployment in terms of swarm performance. To generate a two-layer DRS between multiple groups and a single group, a multi-agent deep reinforcement learning framework is developed in which a QMIX network determines the swarm redeployment, and each deep Q-network determines the single-group redeployment. The proposed method is simulated using Python and a case study demonstrates its effectiveness as a high-quality DRS for large-scale scenarios.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Learning to Routing in UAV Swarm Network: A Multi-Agent Reinforcement Learning Approach
    Wang, Zunliang
    Yao, Haipeng
    Mai, Tianle
    Xiong, Zehui
    Wu, Xiaohua
    Wu, Di
    Guo, Song
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (05) : 6611 - 6624
  • [22] Multi-Agent Deep Reinforcement Learning for Distributed Load Restoration
    Linh Vu
    Tuyen Vu
    Thanh Long Vu
    Srivastava, Anurag
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1749 - 1760
  • [23] UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach
    Hou, Yukai
    Zhao, Jin
    Zhang, Rongqing
    Cheng, Xiang
    Yang, Liuqing
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 568 - 578
  • [24] Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking
    Xia, Zhaoyue
    Du, Jun
    Wang, Jingjing
    Jiang, Chunxiao
    Ren, Yong
    Li, Gang
    Han, Zhu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (01) : 931 - 945
  • [25] Collision Detection and Avoidance for Multi-UAV based on Deep Reinforcement Learning
    Wang, Guanzheng
    Liu, Zhihong
    Xiao, Kun
    Xu, Yinbo
    Yang, Lingjie
    Wang, Xiangke
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7783 - 7789
  • [26] Extrinsic-and-Intrinsic Reward-Based Multi-Agent Reinforcement Learning for Multi-UAV Cooperative Target Encirclement
    Chen, Jinchao
    Wang, Yang
    Zhang, Ying
    Lu, Yantao
    Shu, Qiuhao
    Hu, Yujiao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025,
  • [27] Optimization Design of Multi-UAV Communication Network Based on Reinforcement Learning
    Cao, Zhengyang
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [28] Securing UAV Communication Based on Multi-Agent Deep Reinforcement Learning in the Presence of Smart UAV Eavesdropper
    Wen, Chaoyang
    Fang, Yuan
    Qiu, Ling
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 1164 - 1169
  • [29] Multi-UAV Cooperative Autonomous Navigation Based on Multi-agent Deep Deterministic Policy Gradient
    Li B.
    Yue K.-Q.
    Gan Z.-G.
    Gao P.-X.
    Yuhang Xuebao/Journal of Astronautics, 2021, 42 (06): : 757 - 765
  • [30] Multi-Agent Deep Reinforcement Learning for Joint Decoupled User Association and Trajectory Design in Full-Duplex Multi-UAV Networks
    Dai, Chen
    Zhu, Kun
    Hossain, Ekram
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) : 6056 - 6070