Improving Intrusion Detection Systems with Multi-Agent Deep Reinforcement Learning: Enhanced Centralized and Decentralized Approaches

被引:1
|
作者
Bacha, Amani [1 ]
Ktata, Farah Barika [1 ]
Louati, Faten [2 ]
机构
[1] Sousse Univ, MIRACL Lab, ISSATSo, Sousse, Tunisia
[2] Sfax Univ, MIRACL Lab, FSEGS, Sfax, Tunisia
关键词
Multi-Agent Deep Reinforcement Learning (MADRL); Intrusion Detection System (IDS); Deep Q-Network (DQN); NSL-KDD; MADQN; COCA-MADQN; MADQN-GTN;
D O I
10.5220/0012124600003555
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intrusion detection is a crucial task in the field of computer security as it helps protect these systems against malicious attacks. New techniques have been developed to cope with the increasing complexity of computer systems and the constantly evolving threats. Multi-agent reinforcement learning (MARL), is an extension of Reinforcement Learning (RL) in which agents can learn to detect and respond to intrusions while considering the actions and decisions of the other agents. In this study, we evaluate MARL's performance in detecting network intrusions using the NSL-KDD dataset. We propose two approaches, centralized and decentralized, namely COCA-MADQN and MADQN-GTN. Our approaches show good results in terms of Accuracy, Precision, Recall, and F1-score.
引用
收藏
页码:772 / 777
页数:6
相关论文
共 50 条
  • [11] Deep Multi-Agent Reinforcement Learning for Decentralized Active Hypothesis Testing
    Szostak, Hadar
    Cohen, Kobi
    IEEE ACCESS, 2024, 12 : 130444 - 130459
  • [12] Decentralized Multi-agent Formation Control via Deep Reinforcement Learning
    Gutpa, Aniket
    Nallanthighal, Raghava
    ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 1, 2021, : 289 - 295
  • [13] Value Propagation for Decentralized Networked Deep Multi-agent Reinforcement Learning
    Qu, Chao
    Mannor, Shie
    Xu, Huan
    Qi, Yuan
    Song, Le
    Xiong, Junwu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [14] Multi-Agent Deep Reinforcement Learning for Walker Systems
    Park, Inhee
    Moh, Teng-Sheng
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 490 - 495
  • [15] Decentralized Deterministic Multi-Agent Reinforcement Learning
    Grosnit, Antoine
    Cai, Desmond
    Wynter, Laura
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 1548 - 1553
  • [16] Multi-Agent Reinforcement Learning for Intrusion Detection: A Case Study and Evaluation
    Servin, Arturo
    Kudenko, Daniel
    MULTIAGENT SYSTEM TECHNOLOGIES, PROCEEDINGS, 2008, 5244 : 159 - 170
  • [17] Multi-Agent Reinforcement Learning for Intrusion Detection: A case study and evaluation
    Servin, Arturo
    Kudenko, Daniel
    ECAI 2008, PROCEEDINGS, 2008, 178 : 873 - +
  • [18] An analysis of multi-agent reinforcement learning for decentralized inventory control systems
    Mousa, Marwan
    van de Berg, Damien
    Kotecha, Niki
    Chanona, Ehecatl Antonio del Rio
    Mowbray, Max
    COMPUTERS & CHEMICAL ENGINEERING, 2024, 188
  • [19] A Collaborative Multi-Agent Deep Reinforcement Learning-Based Wireless Power Allocation With Centralized Training and Decentralized Execution
    Kopic, Amna
    Perenda, Erma
    Gacanin, Haris
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (11) : 7006 - 7016
  • [20] On Improving Model-Free Algorithms for Decentralized Multi-Agent Reinforcement Learning
    Mao, Weichao
    Yang, Lin F.
    Zhang, Kaiqing
    Basar, Tamer
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,