Improving Intrusion Detection Systems with Multi-Agent Deep Reinforcement Learning: Enhanced Centralized and Decentralized Approaches

被引:1
|
作者
Bacha, Amani [1 ]
Ktata, Farah Barika [1 ]
Louati, Faten [2 ]
机构
[1] Sousse Univ, MIRACL Lab, ISSATSo, Sousse, Tunisia
[2] Sfax Univ, MIRACL Lab, FSEGS, Sfax, Tunisia
关键词
Multi-Agent Deep Reinforcement Learning (MADRL); Intrusion Detection System (IDS); Deep Q-Network (DQN); NSL-KDD; MADQN; COCA-MADQN; MADQN-GTN;
D O I
10.5220/0012124600003555
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intrusion detection is a crucial task in the field of computer security as it helps protect these systems against malicious attacks. New techniques have been developed to cope with the increasing complexity of computer systems and the constantly evolving threats. Multi-agent reinforcement learning (MARL), is an extension of Reinforcement Learning (RL) in which agents can learn to detect and respond to intrusions while considering the actions and decisions of the other agents. In this study, we evaluate MARL's performance in detecting network intrusions using the NSL-KDD dataset. We propose two approaches, centralized and decentralized, namely COCA-MADQN and MADQN-GTN. Our approaches show good results in terms of Accuracy, Precision, Recall, and F1-score.
引用
收藏
页码:772 / 777
页数:6
相关论文
共 50 条
  • [1] Multi-agent reinforcement learning for intrusion detection
    Servin, Arturo
    Kudenko, Daniel
    ADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS, 2008, 4865 : 211 - 223
  • [2] Decentralized Anomaly Detection via Deep Multi-Agent Reinforcement Learning
    Szostak, Hadar
    Cohen, Kobi
    2022 58TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2022,
  • [3] A Centralized Training with Decentralized Execution Reinforcement Learning for Cooperative Multi-agent Systems with Communication Delay
    Ikeda, Takuma
    Shibuya, Takeshi
    2022 61ST ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS (SICE), 2022, : 135 - 140
  • [4] Attention based multi-agent intrusion detection systems using reinforcement learning
    Sethi, Kamalakanta
    Madhav, Y. Venu
    Kumar, Rahul
    Bera, Padmalochan
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2021, 61
  • [5] Decentralized Multi-Agent Pursuit Using Deep Reinforcement Learning
    de Souza, Cristino, Jr.
    Newbury, Rhys
    Cosgun, Akansel
    Castillo, Pedro
    Vidolov, Boris
    Kulic, Dana
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03): : 4552 - 4559
  • [6] Decentralized intrusion detection for secure cooperative multi-agent systems
    Fagiolini, Adriano
    Valenti, Gianni
    Pallottino, Lucia
    Dini, Gianluca
    Bicchi, Antonio
    PROCEEDINGS OF THE 46TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2007, : 5487 - +
  • [7] Decentralized Anomaly Detection in Cooperative Multi-Agent Reinforcement Learning
    Kazari, Kiarash
    Shereen, Ezzeldin
    Dan, Gyorgy
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 162 - 170
  • [8] Decentralized Incremental Fuzzy Reinforcement Learning for Multi-Agent Systems
    Hamzeloo, Sam
    Jahromi, Mansoor Zolghadri
    INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2020, 28 (01) : 79 - 98
  • [9] On Centralized Critics in Multi-Agent Reinforcement Learning
    Lyu, Xueguang
    Baisero, Andrea
    Xiao, Yuchen
    Daley, Brett
    Amato, Christopher
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2023, 77 : 295 - 354
  • [10] On Centralized Critics in Multi-Agent Reinforcement Learning
    Lyu, Xueguang
    Baisero, Andrea
    Xiao, Yuchen
    Daley, Brett
    Amato, Christopher
    Journal of Artificial Intelligence Research, 2023, 77 : 295 - 354