The Research Of Aircraft Pursuit-Evasion Game Based on Improved DQN

被引:0
|
作者
Cui, Yameng [1 ]
Zheng, Chunsheng [2 ]
Liu, Jiarun [1 ]
Wang, Huixia [1 ]
Hu, Ruiguang [1 ]
Wang, Zhaolei [1 ]
机构
[1] Beijing Aerosp Automat Control Inst, Natl Key Lab Sci & Technol Aerosp Intelligent Con, Beijing, Peoples R China
[2] Beijing Aerosp Automat Control Inst, Beijing, Peoples R China
关键词
Pursuit-evasion game; aircraft; behavioral model; improved DQN;
D O I
10.1109/icus50048.2020.9274907
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The intelligent combat of aircraft has become an important research area. This paper studies the 1Vs1 pursuit-evasion game confrontation scenario of the aircraft, aiming to enable the red agent to find the optimal strategy to avoid the blue interception. First, the aircraft is abstracted into an agent, the kinematics model of the aircraft is simplified, and the behavior model of the aircraft with the bait throwing behavior is established. Based on the improved DQN algorithm, with relative distance, line-of-sight angle and azimuth as the state; the reward function design comprehensively considers the time, number of bait throwing, maneuvering time, and miss distance, and proposes an aircraft pursuit-evasion game algorithm (RB-DQN) in a three-dimensional environment. Experimental results show that the algorithm can effectively control the aircraft to complete the escape mission, and has satisfactory generalization.
引用
收藏
页码:857 / 862
页数:6
相关论文
共 50 条
  • [31] Towards a relaxation of the pursuit-evasion differential game
    Chentsov, Alexander
    Khachay, Daniel
    IFAC PAPERSONLINE, 2019, 52 (13): : 2303 - 2307
  • [32] Multi-impulse pursuit-evasion game in GEO based on improved dung beetle optimization
    Guo, Yanning
    Li, Gaojian
    Yu, Yongbin
    CHINESE SPACE SCIENCE AND TECHNOLOGY, 2024, 44 (04) : 1 - 10
  • [33] Fractional Calculus Guidance Algorithm For Aircraft Pursuit-Evasion
    Chen, Jian
    Wang, Shubo
    Wang, Wei
    Tan, Yu
    Zheng, Yongjun
    Ren, Zhang
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 7817 - 7821
  • [34] AIRCRAFT PURSUIT-EVASION PROBLEMS WITH VARIABLE SPEEDS.
    Prasad, U.R.
    Rajan, N.
    Computers & mathematics with applications, 1987, 13 (1-3): : 111 - 121
  • [35] Pursuit-Evasion Game for Satellites Based on Continuous Thrust Reachable Domain
    Gong, Haoran
    Gong, Shengping
    Li, Junfeng
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2020, 56 (06) : 4626 - 4637
  • [36] Design of Optimal Strategies for the Pursuit-evasion Problem Based on Differential Game
    Liu K.
    Zheng X.-S.
    Lin Y.-M.
    Han L.
    Xia Y.-Q.
    Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (08): : 1840 - 1854
  • [37] ON PURSUIT-EVASION BETWEEN TWO REALISTIC AIRCRAFT.
    Hillberg, C
    Saab Technical Notes Aero, 1983, (75):
  • [38] Multi-Agent Pursuit-Evasion Game Based on Organizational Architecture
    Souidi M.E.H.
    Siam A.
    Pei Z.
    Piao S.
    Journal of Computing and Information Technology, 2019, 27 (01) : 1 - 12
  • [39] An Algorithm for UAV Pursuit-Evasion Game Based on MADDPG and Contrastive Learning
    Wang R.
    Wang X.
    Yuhang Xuebao/Journal of Astronautics, 2024, 45 (02): : 262 - 272
  • [40] The Neural Networks in Optimizing Pursuit-Evasion Game Tactics
    Guo, Zhenhua
    Wang, Wei
    Sun, Lili
    Han, Biqiang
    Zhang, Ying
    DYNAMIC GAMES AND APPLICATIONS, 2025,