Communication Optimization for Multi-agent Reinforcement Learning-based Traffic Control System with Explainable Protocol

被引:0
|
作者
Wang, Han [1 ,2 ]
Wu, Haochen [3 ]
Lu, Juanwu [4 ]
Tang, Fang [5 ]
Delle Monache, Maria Laura [2 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[2] Univ Calif Berkeley, Dept Civil & Environm Engn, Berkeley, CA 94720 USA
[3] Univ Michigan, Dept Aerosp Engn, Ann Arbor, MI USA
[4] Purdue Univ, Lyles Sch Civil Engn, W Lafayette, IN 47907 USA
[5] Arizona State Univ, Sch Sustainable Engn & Built Environm, Tempe, AZ 85287 USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article studies the challenges of multi-agent traffic control systems with a specific focus on the feasibility of communication protocols. We present an innovative approach for optimizing communication in large-scale traffic control systems. In the context of ramp metering coordination, we design and analyze the proposed communication protocols. The first protocol operates without explicit semantic interpretation, providing a baseline for performance. The second builds on the concept of advantageous directions, integrating semantic meaning into communication for enhanced explainability. Comparative results show that our proposed system outperforms the ALINEA algorithm under both protocols. Despite the slightly superior performance of the non-semantic protocol, the advantageous direction protocol yields more interpretable and meaningful results, thereby underscoring the crucial role of explainability in deep learning models. Our approach offers novel insights for the development of interpretable machine learningbased traffic control algorithms. The broader implication of this study emphasizes the importance of addressing communication feasibility in large-scale traffic control systems, illuminating the path toward more efficient, scalable traffic control solutions.
引用
收藏
页码:6068 / 6073
页数:6
相关论文
共 50 条
  • [21] Quantum Finance and Fuzzy Reinforcement Learning-Based Multi-agent Trading System
    Cheng, Chi
    Chen, Bingshen
    Xiao, Ziting
    Lee, Raymond S. T.
    INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2024, 26 (07) : 2224 - 2245
  • [22] Multi-agent deep reinforcement learning with traffic flow for traffic signal control
    Hou, Liang
    Huang, Dailin
    Cao, Jie
    Ma, Jialin
    JOURNAL OF CONTROL AND DECISION, 2025, 12 (01) : 81 - 92
  • [23] Online optimization of traffic policy through multi-agent reinforcement learning
    Sasaki, Y
    Flann, NS
    PROCEEDINGS OF THE 7TH JOINT CONFERENCE ON INFORMATION SCIENCES, 2003, : 1211 - 1214
  • [24] Traffic Optimization in Satellites Communications: A Multi-agent Reinforcement Learning Approach
    Qin, Zeyu
    Yao, Haipeng
    Mai, Tianle
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 269 - 273
  • [25] Traffic Distribution Algorithm Based on Multi-Agent Reinforcement Learning
    Cheng C.
    Teng J.-J.
    Zhao Y.-L.
    Song M.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2019, 42 (06): : 43 - 48and57
  • [26] Multi-Agent Reinforcement Learning With Distributed Targeted Multi-Agent Communication
    Xu, Chi
    Zhang, Hui
    Zhang, Ya
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 2915 - 2920
  • [27] A traffic light control method based on multi-agent deep reinforcement learning algorithm
    Liu, Dongjiang
    Li, Leixiao
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [28] Swarm Reinforcement Learning for traffic signal control based on cooperative multi-agent framework
    Tahifa, Mohammed
    Boumhidi, Jaouad
    Yahyaouy, Ali
    2015 INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV), 2015,
  • [29] A traffic light control method based on multi-agent deep reinforcement learning algorithm
    Dongjiang Liu
    Leixiao Li
    Scientific Reports, 13
  • [30] Multiple intersections traffic signal control based on cooperative multi-agent reinforcement learning
    Liu, Junxiu
    Qin, Sheng
    Su, Min
    Luo, Yuling
    Wang, Yanhu
    Yang, Su
    INFORMATION SCIENCES, 2023, 647