Rebalancing the car-sharing system with reinforcement learning

被引:13
|
作者
Ren, Changwei [1 ]
An, Lixingjian [1 ]
Gu, Zhanquan [2 ]
Wang, Yuexuan [1 ,3 ]
Gao, Yunjun [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou, Peoples R China
[2] Guangzhou Univ, CIAT, Guangzhou, Peoples R China
[3] Univ Hong Kong, Dept Comp Sci, Hongkong, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Reinforcement learning; Car-sharing system; Scheduling;
D O I
10.1007/s11280-020-00804-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the sharing economy boom, there is a notable increase in the number of car-sharing corporations, which provided a variety of travel options and improved convenience and functionality. Owing to the similarity in the travel patterns of the urban population, car-sharing system often faces the problem of imbalance in the number of shared cars within the spatial distribution, especially during the rush hours. There are many challenges in redressing this imbalance, such as insufficient data and the large state space. In this study, we propose a new reward method called Double P (Picking & Parking) Bonus (DPB). We model the research problem as a Markov Decision Process (MDP) problem and introduce Deep Deterministic Policy Gradient, a state-of-the-art reinforcement learning framework, to find a solution. The results show that the rewarding mechanism embodied in the DPB method can indeed guide the users' behaviors through price leverage, increase user stickiness, and cultivate user habits, thereby boosting the service provider's long-term profit. In addition, taking the battery power of the shared car into consideration, we use the method of hierarchical reinforcement learning for station scheduling. This station scheduling method encourages the user to place the car that needs to be charged on the charging post within a certain site. It can ensure the effective use of charging pile resources, thereby rendering the efficient functioning of shared cars.
引用
收藏
页码:2491 / 2511
页数:21
相关论文
共 50 条
  • [31] Mining Spatiotemporal Characteristics of Car-sharing Demand
    Tian, Jing-Jing
    Xie, Dong-Fan
    Ding, Fu-Jun
    2018 INTERNATIONAL SYMPOSIUM ON POWER ELECTRONICS AND CONTROL ENGINEERING (ISPECE 2018), 2019, 1187
  • [32] Electro Vehicle Car-Sharing System A Simulation Model for Big Cities
    Rozhdestvenskiy, Dmitry
    Bouchner, Petr
    ERCIM NEWS, 2013, (94): : 22 - 23
  • [33] The Location Routing Problem of the Car-Sharing System with Autonomous Electric Vehicles
    Bingshan Ma
    Dawei Hu
    Xue Wu
    KSCE Journal of Civil Engineering, 2021, 25 : 3107 - 3120
  • [34] The Location Routing Problem of the Car-Sharing System with Autonomous Electric Vehicles
    Ma, Bingshan
    Hu, Dawei
    Wu, Xue
    KSCE JOURNAL OF CIVIL ENGINEERING, 2021, 25 (08) : 3107 - 3120
  • [35] One-way car-sharing system based on recharging strategy
    Ma, Jian
    Chen, Lixin
    Mahmood, A.
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 2290 - 2294
  • [36] Towards Smart Transportation System: A Case Study on the Rebalancing Problem of Bike Sharing System Based on Reinforcement Learning
    Li, Guofu
    Cao, Ning
    Zhu, Pengjia
    Zhang, Yanwu
    Zhang, Yingying
    Li, Lei
    Li, Qingyuan
    Zhang, Yu
    JOURNAL OF ORGANIZATIONAL AND END USER COMPUTING, 2021, 33 (03) : 35 - 49
  • [37] Car-Sharing - "Car-on-call" for reclaiming street space
    Glotz-Richter, Michael
    TRANSPORT RESEARCH ARENA 2012, 2012, 48 : 1454 - 1463
  • [38] Optimizing relocation operations in electric car-sharing
    Gambella, Claudio
    Malaguti, Enrico
    Masini, Filippo
    Vigo, Daniele
    OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE, 2018, 81 : 234 - 245
  • [39] Strategies of Car-Sharing Promotion in Real Market
    Luan, Xin
    Cheng, Lin
    Zhou, Yang
    Tang, Fang
    2018 3RD IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION ENGINEERING (ICITE), 2018, : 159 - 163
  • [40] CAR-SHARING: THE IMPACT ON METROPOLITAN SPATIAL STRUCTURES
    Smolnicki, Piotr Marek
    Soltys, Jacek
    CBU INTERNATIONAL CONFERENCE PROCEEDINGS 2016: INNOVATIONS IN SCIENCE AND EDUCATION, 2016, 4 : 814 - 819