Multi-agent broad reinforcement learning for intelligent traffic light control

被引:30
|
作者
Zhu, Ruijie [1 ]
Li, Lulu [1 ]
Wu, Shuning [1 ]
Lv, Pei [1 ]
Li, Yafei [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp & Artif Intelligence, Zhengzhou, Peoples R China
基金
美国国家科学基金会;
关键词
Intelligent traffic light control; Deep neural networks; Broad reinforcment learning; Multi -agent deep reinforcement learning;
D O I
10.1016/j.ins.2022.11.062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intelligent traffic light control (ITLC) aims to relieve traffic congestion. Some multi-agent deep reinforcement learning (MADRL) algorithms have been proposed for ITLC, and most of them use deep neural networks to make decisions. However, the abundant parameters of deep structure lead to the time-consuming training process of MADRL. Recently, a broad reinforcement learning (BRL) approach has been proposed to improve the efficiency of training for an agent. Unlike MADRL algorithms that use deep architecture, BRL utilizes a broad architecture. In this paper, we propose a multi-agent broad reinforcement learning (MABRL) algorithm for ITLC. The MABRL algorithm adopts the broad network to process the joint information and updates the parameters using ridge regression. To increase the effectiveness of interaction among agents, we design a dynamic interaction mechanism (DIM) based on the attention mechanism. The DIM enables agents to aggregate information on particular intersections at appropriate moments. We conduct experiments on three different datasets. The results demonstrate that the effectiveness of MABRL outperforms several state-of-the-art algorithms in alleviating traffic congestion with shorter training time. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:509 / 525
页数:17
相关论文
共 50 条
  • [41] Swarm Reinforcement Learning for traffic signal control based on cooperative multi-agent framework
    Tahifa, Mohammed
    Boumhidi, Jaouad
    Yahyaouy, Ali
    2015 INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV), 2015,
  • [42] Mean Field Multi-Agent Reinforcement Learning Method for Area Traffic Signal Control
    Zhang, Zundong
    Zhang, Wei
    Liu, Yuke
    Xiong, Gang
    ELECTRONICS, 2023, 12 (22)
  • [43] Multiple intersections traffic signal control based on cooperative multi-agent reinforcement learning
    Liu, Junxiu
    Qin, Sheng
    Su, Min
    Luo, Yuling
    Wang, Yanhu
    Yang, Su
    INFORMATION SCIENCES, 2023, 647
  • [44] Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control
    Chu, Tianshu
    Wang, Jie
    Codeca, Lara
    Li, Zhaojian
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (03) : 1086 - 1095
  • [45] Multi-Agent Reinforcement Learning
    Stankovic, Milos
    2016 13TH SYMPOSIUM ON NEURAL NETWORKS AND APPLICATIONS (NEUREL), 2016, : 43 - 43
  • [46] Multi-Agent Reinforcement Learning Control for Ramp Metering
    Fares, Ahmed
    Gomaa, Walid
    PROGRESS IN SYSTEMS ENGINEERING, 2015, 366 : 167 - 173
  • [47] Scalable Reinforcement Learning Policies for Multi-Agent Control
    Hsu, Christopher D.
    Jeong, Heejin
    Pappas, George J.
    Chaudhari, Pratik
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 4785 - 4791
  • [48] Multi-Agent Reinforcement Learning for Coordinating Communication and Control
    Mason, Federico
    Chiariotti, Federico
    Zanella, Andrea
    Popovski, Petar
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (04) : 1566 - 1581
  • [49] MARLYC: Multi-Agent Reinforcement Learning Yaw Control
    Kadoche, Elie
    Gourvenec, Sebastien
    Pallud, Maxime
    Levent, Tanguy
    RENEWABLE ENERGY, 2023, 217
  • [50] Dynamic Multi-Agent Reinforcement Learning for Control Optimization
    Fagan, Derek
    Meier, Rene
    PROCEEDINGS FIFTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, MODELLING AND SIMULATION, 2014, : 99 - 104