Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions Using Reinforcement Learning

被引:3
|
作者
Ye, Qiming [1 ]
Feng, Yuxiang [1 ]
Macias, Jose Javier Escribano [1 ]
Stettler, Marc [1 ]
Angeloudis, Panagiotis [1 ]
机构
[1] Imperial Coll London, Ctr Transport Studies, Dept Civil & Environm Engn, London SW72AZ, England
关键词
Autonomous vehicles; pedestrians; smart city; intelligent transport system; reinforcement learning; infrastruc-ture management;
D O I
10.1109/TITS.2022.3220110
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an operational framework that can dynamically generate ROW plans for AVs and pedestrians in response to real-time demand. Based on microscopic traffic simulation, this study explores Reinforcement Learning (RL) methods for evolving ROW compositions. We implement a centralised learning paradigm and a distributive learning paradigm to separately perform the dynamic control on several road network configurations. Experimental results indicate that the algorithms have the potential to improve traffic flow efficiency and allocate more space for pedestrians. Furthermore, the distributive learning algorithm outperforms its centralised counterpart regarding computational cost (49.55%), benchmark rewards (25.35%), best cumulative rewards (24.58%), optimal actions (13.49%) and rate of convergence. This novel road management technique could potentially contribute to the flow-adaptive and active mobility-friendly streets in the AVs era.
引用
收藏
页码:2024 / 2034
页数:11
相关论文
共 50 条
  • [21] Improved Robustness and Safety for Autonomous Vehicle Control with Adversarial Reinforcement Learning
    Ma, Xiaobai
    Driggs-Campbell, Katherine
    Kochenderfer, Mykel J.
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1665 - 1671
  • [22] On-road vehicle and pedestrian detection using improved codebook model
    Li, Xiangyang
    Fang, Xiangzhong
    Lu, Qingchu
    2013 IEEE INTERNATIONAL CONFERENCE ON VEHICULAR ELECTRONICS AND SAFETY (ICVES), 2013, : 1 - 4
  • [23] Stochastic pedestrian avoidance for autonomous vehicles using hybrid reinforcement learning
    Li, Huiqian
    Huang, Jin
    Cao, Zhong
    Yang, Diange
    Zhong, Zhihua
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2023, 24 (01) : 131 - 140
  • [24] Modeling Vehicle-Pedestrian Encountering Risks in the Natural Driving Environment Using Machine Learning Algorithms
    Gandhi, Priyanka
    Luo, Xiao
    Tian, Renran
    DIGITAL HUMAN MODELING AND APPLICATIONS IN HEALTH, SAFETY, ERGONOMICS AND RISK MANAGEMENT. HUMAN BODY AND MOTION, DHM 2019, PT I, 2019, 11581 : 382 - 393
  • [25] Designing Wearable Augmented Reality Concepts to Support Scalability in Autonomous Vehicle-Pedestrian Interaction
    Tram Thi Minh Tran
    Parker, Callum
    Wang, Yiyuan
    Tomitsch, Martin
    FRONTIERS IN COMPUTER SCIENCE, 2022, 4
  • [26] Autonomous Vehicle-Pedestrian Interaction Modeling Platform: A Case Study in Four Major Cities
    Shoman, Maged
    Lanzaro, Gabriel
    Sayed, Tarek
    Gargoum, Suliman
    JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS, 2024, 150 (09)
  • [27] Game theory modeling for vehicle-pedestrian interactions and simulation based on cellular automata
    Wu, WenJing
    Chen, RunChao
    Jia, Hongfei
    Li, Yongxing
    Liang, ZhiKang
    INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2019, 30 (04):
  • [28] Docking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning
    Anderlini, Enrico
    Parker, Gordon G.
    Thomas, Giles
    APPLIED SCIENCES-BASEL, 2019, 9 (17):
  • [29] Autonomous Vehicle for Obstacle Detection and Avoidance Using Reinforcement Learning
    Arvind, C. S.
    Senthilnath, J.
    SOFT COMPUTING FOR PROBLEM SOLVING, SOCPROS 2018, VOL 1, 2020, 1048 : 55 - 66
  • [30] Wireless Control of Autonomous Guided Vehicle Using Reinforcement Learning
    Ana, Pedro M. de Sant
    Marchenko, Nikolaj
    Popovski, Petar
    Soret, Beatriz
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,