Research on the multiple unmanned aerial vehicle swarm confrontation strategy based on the dynamic Bayesian network

被引:0
|
作者
Jia Y. [1 ,2 ]
Jiao Y. [1 ]
Chen X. [1 ]
Li Q. [1 ,2 ]
Lu X. [1 ]
机构
[1] School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing
[2] Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education, University of Science and Technology Beijing, Beijing
来源
Gongcheng Kexue Xuebao/Chinese Journal of Engineering | 2024年 / 46卷 / 07期
关键词
distributed cooperation; dynamic Bayesian network; Kuhn–Munkres algorithm; Lanchester equation; swarm confrontation;
D O I
10.13374/j.issn2095-9389.2023.10.12.001
中图分类号
学科分类号
摘要
The swarming confrontation problem of unmanned aerial vehicles (UAVs) has been a focal point and challenge in the field of complex systems research in recent years, with significant application value in the military, network security, and artificial intelligence industries. In real-world confrontations, the uncertainty of the environment and the diversity of intelligent agent behaviors render the problem difficult to model, and operational environments necessitate intelligent agents to provide real-time, efficient responses to changes in the situation. To address these challenges, this paper proposes a research framework for the swarming confrontation problem of UAVs. First, an adversarial game model is developed based on the improved Lanchester equation to solve this problem toward the red and blue swarms. The adversarial game model focuses on describing the dynamic quantity change process of the red and blue UAV swarms. Second, based on the above confrontation model, a multiple-task assignment problem is investigated, which is derived from the above confrontation process. A new assignment strategy of these UAVs for strike tasks is proposed by adaptive improvement based on the traditional Kuhn–Munkres algorithm. This strategy is suitable for the red and blue parties under the adversarial environment, which can effectively complete the strike tasks and improve the confrontation ability of these UAVs. Third, a swarming confrontation algorithm is proposed to improve the environmental suitability of each UAV, especially when dealing with the influences of a series of uncertain factors generated by the real-time process of swarming offensive and defensive confrontations. This algorithm is based on the dynamic Bayesian network structure and focuses on predicting and evaluating the uncertainty generated during the confrontation process of the red and blue UAV swarms and performing corresponding reasoning and prediction through the dynamic Bayesian network, which can effectively reduce the complexity and calculation of the confrontation model and widely improve the accuracy and speed of decision-making. Finally, a Python-based real-time simulation platform is built on the above-mentioned confrontation model to illustrate the evolutionary process of the red and blue UAV swarms and to verify the effectiveness of the proposed algorithm by comparison with the most classic artificial potential field method. The simulation results reveal that the above framework can demonstrate the real-time offensive and defensive confrontation process of red and blue UAV swarms according to the designed penetration mission, effectively solve the problem of task assignment conflicts between red and blue swarms, properly predict and evaluate the uncertainty issues derived from the swarm confrontation process, and improve the combat capabilities of UAV swarms. © 2024 Science Press. All rights reserved.
引用
收藏
页码:1216 / 1226
页数:10
相关论文
共 31 条
  • [1] Xuan S Z, Zhou H, Ke L J., Review of UAV swarm confrontation game, Command Inf Syst Technol, 12, 2, (2021)
  • [2] Hu J, Wellman M P., Multiagent reinforcement learning: Theoretical framework and an algorithm, Proceedings of 15th International Conference on Machine Learning, (1998)
  • [3] Beard R W, McLain T W, Goodrich M A, Et al., Coordinated target assignment and intercept for unmanned air vehicles, IEEE Trans Robot Autom, 18, 6, (2002)
  • [4] Pongpunwattana A., Real-time Planning for Teams of Autonomous Vehicles in Dynamic Uncertain Environments [Dissertation], (2004)
  • [5] Li Y, Han W, Wang Y Q., Deep reinforcement learning with application to air confrontation intelligent decision-making of manned/unmanned aerial vehicle cooperative system, IEEE Access, 8, (2020)
  • [6] Zhang J, Xing J H., Cooperative task assignment of multi-UAV system, Chin J Aeronaut, 33, 11, (2020)
  • [7] Ji X, Zhang W P, Xiang F T, Et al., A swarm confrontation method based on Lanchester law and Nash equilibrium, Electronics, 11, 6, (2022)
  • [8] Xiang L, Xie T., Research on UAV swarm confrontation task based on MADDPG algorithm, 2020 5th International Conference on Mechanical, Control and Computer Engineering (ICMCCE), (2020)
  • [9] Wang B L, Li S G, Gao X Z, Et al., UAV swarm confrontation using hierarchical multiagent reinforcement learning, Int J Aerosp Eng, (2021)
  • [10] Zohdi T I., The Game of Drones: rapid agent-based machine-learning models for multi-UAV path planning, Comput Mech, 65, 1, (2020)