Communication Optimization for Multi-agent Reinforcement Learning-based Traffic Control System with Explainable Protocol

被引:0
|
作者
Wang, Han [1 ,2 ]
Wu, Haochen [3 ]
Lu, Juanwu [4 ]
Tang, Fang [5 ]
Delle Monache, Maria Laura [2 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[2] Univ Calif Berkeley, Dept Civil & Environm Engn, Berkeley, CA 94720 USA
[3] Univ Michigan, Dept Aerosp Engn, Ann Arbor, MI USA
[4] Purdue Univ, Lyles Sch Civil Engn, W Lafayette, IN 47907 USA
[5] Arizona State Univ, Sch Sustainable Engn & Built Environm, Tempe, AZ 85287 USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article studies the challenges of multi-agent traffic control systems with a specific focus on the feasibility of communication protocols. We present an innovative approach for optimizing communication in large-scale traffic control systems. In the context of ramp metering coordination, we design and analyze the proposed communication protocols. The first protocol operates without explicit semantic interpretation, providing a baseline for performance. The second builds on the concept of advantageous directions, integrating semantic meaning into communication for enhanced explainability. Comparative results show that our proposed system outperforms the ALINEA algorithm under both protocols. Despite the slightly superior performance of the non-semantic protocol, the advantageous direction protocol yields more interpretable and meaningful results, thereby underscoring the crucial role of explainability in deep learning models. Our approach offers novel insights for the development of interpretable machine learningbased traffic control algorithms. The broader implication of this study emphasizes the importance of addressing communication feasibility in large-scale traffic control systems, illuminating the path toward more efficient, scalable traffic control solutions.
引用
收藏
页码:6068 / 6073
页数:6
相关论文
共 50 条
  • [41] Multi-agent deep reinforcement learning-based maintenance optimization for multi-dependent component systems
    Do, Phuc
    Nguyen, Van-Thai
    Voisin, Alexandre
    Iung, Benoit
    Neto, Waldomiro Alves Ferreira
    Neto, Ferreira
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 245
  • [42] Reinforcement Learning-Based Cooperative Traffic Control System
    Barta, Zoltan
    Kovacs, Szilard
    Botzheim, Janos
    COMPUTATIONAL COLLECTIVE INTELLIGENCE, PT II, ICCCI 2024, 2024, 14811 : 176 - 188
  • [43] Learning structured communication for multi-agent reinforcement learning
    Sheng, Junjie
    Wang, Xiangfeng
    Jin, Bo
    Yan, Junchi
    Li, Wenhao
    Chang, Tsung-Hui
    Wang, Jun
    Zha, Hongyuan
    AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2022, 36 (02)
  • [44] Learning structured communication for multi-agent reinforcement learning
    Junjie Sheng
    Xiangfeng Wang
    Bo Jin
    Junchi Yan
    Wenhao Li
    Tsung-Hui Chang
    Jun Wang
    Hongyuan Zha
    Autonomous Agents and Multi-Agent Systems, 2022, 36
  • [45] Underwater Acoustic MAC Protocol for Multi-Objective Optimization Based on Multi-Agent Reinforcement Learning
    Jiang, Jinfang
    Dong, Yiling
    Han, Guangjie
    Su, Gang
    DRONES, 2025, 9 (02)
  • [46] Micro Junction Agent: A Scalable Multi-agent Reinforcement Learning Method for Traffic Control
    Choi, BumKyu
    Choe, Jean Seong Bjorn
    Kim, Jong-kook
    ICAART: PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 3, 2022, : 509 - 515
  • [47] MACRO: Multi-agent Reinforcement Learning-based Cross-layer Optimization of Operational Amplifier
    Chen, Zihao
    Meng, Songlei
    Yang, Fan
    Shang, Li
    Zeng, Xuan
    29TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2024, 2024, : 423 - 428
  • [48] Communicate with Traffic Lights and Vehicles Based on Multi-Agent Reinforcement Learning
    Wu, Qiang
    Zhi, Peng
    Wei, Yongqiang
    Zhang, Liang
    Wu, Jianqing
    Zhou, Qingguo
    Zhou, Qiang
    Gao, Pengfei
    PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2021, : 843 - 848
  • [49] Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning
    Li, Zhenning
    Yu, Hao
    Zhang, Guohui
    Dong, Shangjia
    Xu, Cheng-Zhong
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 125
  • [50] Multi-Agent Reinforcement Learning for Convex Optimization
    Morcos, Amir
    West, Aaron
    Maguire, Brian
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS III, 2021, 11746