Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

被引:0
|
作者
Peng, Wenshen [1 ]
He, Chuan [1 ]
Cao, Fei [1 ]
Hu, Changhua [1 ]
Jiao, Licheng [2 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Radar; Games; Decision making; Electronic countermeasures; Convergence; Spaceborne radar; Radar countermeasures; Indexes; Signal processing algorithms; Multi-agent deep reinforcement learning (MADRL); neural fictitious self-play (NFSP); radar anti-jamming; extensive-form game (EFG); decision making; GAME-THEORY;
D O I
10.1109/LSP.2024.3493797
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As jamming systems continue to evolve, jammers are becoming increasingly complex. They modify their strategies in response to changes in radar status, thereby creating a dynamic confrontation with the radar. Currently, deep reinforcement learning (DRL) methods are widely employed in the decision-making process for radar anti-jamming strategies; however, most of these methods overlook the learning capabilities of the jammer. This letter proposes a novel multi-agent deep reinforcement learning (MADRL) method that leverages the robust capabilities of the neural fictitious self-play (NFSP) method and extensive-form game (EFG) frameworks to address multi-agent interactions and partial information observability challenges. The letter primarily discusses the model design, which includes the construction of the EFG framework, hierarchical optimization of the action space, and the design of the reward function. Comparative results with other state-of-the-art methods demonstrate that this approach achieves significant accuracy and rapid convergence in anti-jamming decision-making, thereby effectively enhancing the intelligent anti-jamming capabilities of radar systems.
引用
收藏
页码:3114 / 3118
页数:5
相关论文
共 50 条
  • [1] Multi-agent Reinforcement Learning Based Cognitive Anti-jamming
    Aref, Mohamed A.
    Jayaweera, Sudharman K.
    Machuzak, Stephen
    2017 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2017,
  • [2] A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks
    Yao, Fuqiang
    Jia, Luliang
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2019, 8 (04) : 1024 - 1027
  • [3] A multi-agent reinforcement learning anti-jamming method with partially overlapping channels
    Zhang, Yunpeng
    Jia, Luliang
    Qi, Nan
    Xu, Yifan
    Chen, Xueqiang
    IET COMMUNICATIONS, 2021, 15 (19) : 2461 - 2468
  • [4] Improving anti-jamming decision-making strategies for cognitive radar via multi-agent deep reinforcement learning
    Jiang, Wen
    Ren, Yihui
    Wang, Yanping
    DIGITAL SIGNAL PROCESSING, 2023, 135
  • [5] Intelligent Anti-Jamming Communication for Wireless Sensor Networks: A Multi-Agent Reinforcement Learning Approach
    Zhou Q.
    Li Y.
    Niu Y.
    Niu, Yingtao (niuyingtao78@163.com), 2021, Institute of Electrical and Electronics Engineers Inc. (02): : 775 - 784
  • [6] Reinforcement Learning Based Techniques for Radar Anti-Jamming
    Aziz, Muhammad Majid
    Maud, Abdur Rahman M.
    Habib, Aamir
    PROCEEDINGS OF 2021 INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGIES (IBCAST), 2021, : 1021 - 1025
  • [7] Reinforcement Learning Based Techniques for Radar Anti-Jamming
    Institute of Space Technology, Electrical Engineering Department, Islamabad, Pakistan
    Proc. Int. Bhurban Conf. Appl. Sci. Technol., IBCAST, (1021-1025):
  • [8] GPDS: A multi-agent deep reinforcement learning game for anti-jamming secure computing in MEC network
    Chen, Miaojiang
    Liu, Wei
    Zhang, Ning
    Li, Junling
    Ren, Yingying
    Yi, Meng
    Liu, Anfeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
  • [9] Mean-Field Multi-Agent Reinforcement Learning for Adaptive Anti-Jamming Channel Selection in UAV Communications
    Du, Feng
    Li, Jun
    Lin, Yan
    Wang, Zhe
    Qian, Yuwen
    2022 IEEE 14th International Conference on Wireless Communications and Signal Processing, WCSP 2022, 2022, : 910 - 915
  • [10] Mean-Field Multi-Agent Reinforcement Learning for Adaptive Anti-Jamming Channel Selection in UAV Communications
    Du, Feng
    Li, Jun
    Lin, Yan
    Wang, Zhe
    Qian, Yuwen
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 910 - 915