Rebalancing the car-sharing system with reinforcement learning

被引:13
|
作者
Ren, Changwei [1 ]
An, Lixingjian [1 ]
Gu, Zhanquan [2 ]
Wang, Yuexuan [1 ,3 ]
Gao, Yunjun [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou, Peoples R China
[2] Guangzhou Univ, CIAT, Guangzhou, Peoples R China
[3] Univ Hong Kong, Dept Comp Sci, Hongkong, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Reinforcement learning; Car-sharing system; Scheduling;
D O I
10.1007/s11280-020-00804-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the sharing economy boom, there is a notable increase in the number of car-sharing corporations, which provided a variety of travel options and improved convenience and functionality. Owing to the similarity in the travel patterns of the urban population, car-sharing system often faces the problem of imbalance in the number of shared cars within the spatial distribution, especially during the rush hours. There are many challenges in redressing this imbalance, such as insufficient data and the large state space. In this study, we propose a new reward method called Double P (Picking & Parking) Bonus (DPB). We model the research problem as a Markov Decision Process (MDP) problem and introduce Deep Deterministic Policy Gradient, a state-of-the-art reinforcement learning framework, to find a solution. The results show that the rewarding mechanism embodied in the DPB method can indeed guide the users' behaviors through price leverage, increase user stickiness, and cultivate user habits, thereby boosting the service provider's long-term profit. In addition, taking the battery power of the shared car into consideration, we use the method of hierarchical reinforcement learning for station scheduling. This station scheduling method encourages the user to place the car that needs to be charged on the charging post within a certain site. It can ensure the effective use of charging pile resources, thereby rendering the efficient functioning of shared cars.
引用
收藏
页码:2491 / 2511
页数:21
相关论文
共 50 条
  • [1] Rebalancing the car-sharing system with reinforcement learning
    Changwei Ren
    Lixingjian An
    Zhanquan Gu
    Yuexuan Wang
    Yunjun Gao
    World Wide Web, 2020, 23 : 2491 - 2511
  • [2] Communication-aware distributed rebalancing for cooperative car-sharing service
    Hayashi, Naoki
    Sakurama, Kazunori
    IET CONTROL THEORY AND APPLICATIONS, 2023, 17 (07): : 850 - 867
  • [3] Identifying key elements in a car-sharing system for constructing a comprehensive car-sharing model
    Qu Min
    Xiong Xing-fu
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 38 (02) : 2297 - 2309
  • [4] Safety and Security of the Car-Sharing System
    Arm, J. .
    Dvorsky, P.
    Fiedler, P.
    Falcou, C.
    Orlicky, J.
    IFAC PAPERSONLINE, 2022, 55 (04): : 121 - 126
  • [5] Vehicle Rebalancing With Charging Scheduling in One-Way Car-Sharing Systems
    Guo, Ge
    Xu, Tao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (05) : 4342 - 4351
  • [6] A fundamental study of car-sharing system by citizen
    Fukuzawa, Y
    Shimazaki, T
    Shimohara, S
    Proceedings of the Eastern Asia Society for Transportation Studies, Vol 5, 2005, 5 : 1585 - 1594
  • [7] The Construction of Car-Sharing Location Index System
    Xiao, Xiong
    Jiang, Xia
    Ni, Bin
    PROCEEDINGS OF THE 2017 7TH INTERNATIONAL CONFERENCE ON SOCIAL NETWORK, COMMUNICATION AND EDUCATION (SNCE 2017), 2017, 82 : 303 - 307
  • [8] Car-sharing in the context of car operation
    Turon, K.
    Kubik, A.
    Lazarz Boguslaw, B.
    Czech, P.
    Stanik, Z.
    INTERNATIONAL AUTOMOTIVE CONFERENCE (KONMOT2018), 2018, 421
  • [9] Does Car-Sharing Reduce Car-Use? An Impact Evaluation of Car-Sharing in Flanders, Belgium
    Chapman, Donald A.
    Eyckmans, Johan
    Van Acker, Karel
    SUSTAINABILITY, 2020, 12 (19)
  • [10] Rebalancing Docked Bicycle Sharing System with Approximate Dynamic Programming and Reinforcement Learning
    Seo, Young-Hyun
    Kim, Dong-Kyu
    Kang, Seungmo
    Byon, Young-Ji
    Kho, Seung-Young
    JOURNAL OF ADVANCED TRANSPORTATION, 2022, 2022