Improving Intrusion Detection Systems with Multi-Agent Deep Reinforcement Learning: Enhanced Centralized and Decentralized Approaches

被引:1
|
作者
Bacha, Amani [1 ]
Ktata, Farah Barika [1 ]
Louati, Faten [2 ]
机构
[1] Sousse Univ, MIRACL Lab, ISSATSo, Sousse, Tunisia
[2] Sfax Univ, MIRACL Lab, FSEGS, Sfax, Tunisia
关键词
Multi-Agent Deep Reinforcement Learning (MADRL); Intrusion Detection System (IDS); Deep Q-Network (DQN); NSL-KDD; MADQN; COCA-MADQN; MADQN-GTN;
D O I
10.5220/0012124600003555
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intrusion detection is a crucial task in the field of computer security as it helps protect these systems against malicious attacks. New techniques have been developed to cope with the increasing complexity of computer systems and the constantly evolving threats. Multi-agent reinforcement learning (MARL), is an extension of Reinforcement Learning (RL) in which agents can learn to detect and respond to intrusions while considering the actions and decisions of the other agents. In this study, we evaluate MARL's performance in detecting network intrusions using the NSL-KDD dataset. We propose two approaches, centralized and decentralized, namely COCA-MADQN and MADQN-GTN. Our approaches show good results in terms of Accuracy, Precision, Recall, and F1-score.
引用
收藏
页码:772 / 777
页数:6
相关论文
共 50 条
  • [41] Hybrid Centralized Training and Decentralized Execution Reinforcement Learning in Multi-Agent Path-Finding Simulations
    Chen, Hua-Ching
    Li, Shih-An
    Chang, Tsung-Han
    Feng, Hsuan-Ming
    Chen, Yun-Chien
    APPLIED SCIENCES-BASEL, 2024, 14 (10):
  • [42] A Multi-Agent Deep Reinforcement Learning Approach for Practical Decentralized UAV Collision Avoidance
    Thumiger, Nicholas
    Deghat, Mohammad
    IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 2174 - 2179
  • [43] Decentralized Computation Offloading with Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective
    Hwang, Sangwon
    Lee, Hoon
    Park, Juseong
    Lee, Inkyu
    IEEE WIRELESS COMMUNICATIONS, 2022, 29 (04) : 24 - 31
  • [44] Decentralized network level adaptive signal control by multi-agent deep reinforcement learning
    Gong, Yaobang
    Abdel-Aty, Mohamed
    Cai, Qing
    Rahman, Md Sharikur
    TRANSPORTATION RESEARCH INTERDISCIPLINARY PERSPECTIVES, 2019, 1
  • [45] HALFTONING WITH MULTI-AGENT DEEP REINFORCEMENT LEARNING
    Jiang, Haitian
    Xiong, Dongliang
    Jiang, Xiaowen
    Yin, Aiguo
    Ding, Li
    Huang, Kai
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 641 - 645
  • [46] Deep reinforcement learning for multi-agent interaction
    Ahmed, Ibrahim H.
    Brewitt, Cillian
    Carlucho, Ignacio
    Christianos, Filippos
    Dunion, Mhairi
    Fosong, Elliot
    Garcin, Samuel
    Guo, Shangmin
    Gyevnar, Balint
    McInroe, Trevor
    Papoudakis, Georgios
    Rahman, Arrasy
    Schafer, Lukas
    Tamborski, Massimiliano
    Vecchio, Giuseppe
    Wang, Cheng
    Albrecht, Stefano, V
    AI COMMUNICATIONS, 2022, 35 (04) : 357 - 368
  • [47] A Study for Comparative Analysis of Dueling DQN and Centralized Critic Approaches in Multi-Agent Reinforcement Learning
    Sugimoto, Masashi
    Hasegawa, Kaito
    Ishida, Yuuki
    Ohnishi, Rikuto
    Nakagami, Kouki
    Tsuzuki, Shinji
    Urushihara, Shiro
    Sori, Hitoshi
    JOURNAL OF ROBOTICS AND MECHATRONICS, 2024, 36 (03) : 589 - 602
  • [48] Multi-agent deep reinforcement learning: a survey
    Sven Gronauer
    Klaus Diepold
    Artificial Intelligence Review, 2022, 55 : 895 - 943
  • [49] Deep Multi-Agent Reinforcement Learning: A Survey
    Liang X.-X.
    Feng Y.-H.
    Ma Y.
    Cheng G.-Q.
    Huang J.-C.
    Wang Q.
    Zhou Y.-Z.
    Liu Z.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (12): : 2537 - 2557
  • [50] Lenient Multi-Agent Deep Reinforcement Learning
    Palmer, Gregory
    Tuyls, Karl
    Bloembergen, Daan
    Savani, Rahul
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18), 2018, : 443 - 451