Rebalancing the car-sharing system with reinforcement learning

被引:13
|
作者
Ren, Changwei [1 ]
An, Lixingjian [1 ]
Gu, Zhanquan [2 ]
Wang, Yuexuan [1 ,3 ]
Gao, Yunjun [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou, Peoples R China
[2] Guangzhou Univ, CIAT, Guangzhou, Peoples R China
[3] Univ Hong Kong, Dept Comp Sci, Hongkong, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Reinforcement learning; Car-sharing system; Scheduling;
D O I
10.1007/s11280-020-00804-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the sharing economy boom, there is a notable increase in the number of car-sharing corporations, which provided a variety of travel options and improved convenience and functionality. Owing to the similarity in the travel patterns of the urban population, car-sharing system often faces the problem of imbalance in the number of shared cars within the spatial distribution, especially during the rush hours. There are many challenges in redressing this imbalance, such as insufficient data and the large state space. In this study, we propose a new reward method called Double P (Picking & Parking) Bonus (DPB). We model the research problem as a Markov Decision Process (MDP) problem and introduce Deep Deterministic Policy Gradient, a state-of-the-art reinforcement learning framework, to find a solution. The results show that the rewarding mechanism embodied in the DPB method can indeed guide the users' behaviors through price leverage, increase user stickiness, and cultivate user habits, thereby boosting the service provider's long-term profit. In addition, taking the battery power of the shared car into consideration, we use the method of hierarchical reinforcement learning for station scheduling. This station scheduling method encourages the user to place the car that needs to be charged on the charging post within a certain site. It can ensure the effective use of charging pile resources, thereby rendering the efficient functioning of shared cars.
引用
收藏
页码:2491 / 2511
页数:21
相关论文
共 50 条
  • [41] GIS Application for Stimulating Car-Sharing Activity
    Burinskiene, Marija
    Uspalyte-Vitkuniene, Rasa
    Stauskis, Gintaras
    2018 INTERNATIONAL JOINT CONFERENCE ON INFORMATION, MEDIA AND ENGINEERING (ICIME), 2018, : 215 - 219
  • [42] An economic and operational evaluation of urban car-sharing
    Fellows, NT
    Pitfield, DE
    TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT, 2000, 5 (01) : 1 - 10
  • [43] Study on the Optimization of Parking Location of Car-sharing
    Tu Jie
    Wu Juan
    Zeng Yunhao
    Hu Xiaoyue
    2020 IEEE 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION ENGINEERING (IEEE ICITE 2020), 2020, : 434 - 440
  • [44] Research on the Influencing Factors of Using Behavior Intention of Automated Car-Sharing System
    Lv, Fengfei
    Zhang, Junyou
    Wang, Shufeng
    Luo, Yuqiu
    Gao, Han
    Zhang, Jie
    2022 IEEE 7TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION ENGINEERING, ICITE, 2022, : 320 - 325
  • [45] Designing a Crowd-Based Relocation System-The Case of Car-Sharing
    Brendel, Alfred Benedikt
    Lichtenberg, Sascha
    Morana, Stefan
    Prinz, Christoph
    Hillmann, Boris M.
    SUSTAINABILITY, 2022, 14 (12)
  • [46] The allocation problem of electric car-sharing system: A data-driven approach
    Huo, Xiang
    Wu, Xinkai
    Li, Ming
    Zheng, Nan
    Yu, Guizhen
    TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT, 2020, 78
  • [47] Personalized Instrument Cluster for Car-sharing Service: Like my car
    Kwon, Young-Jin
    Kim, KyongHo
    Kim, Do-Hyun
    11TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE: DATA, NETWORK, AND AI IN THE AGE OF UNTACT (ICTC 2020), 2020, : 1717 - 1719
  • [48] Tight competitive analyses of online car-sharing problems
    Liang, Ya-Chun
    Lai, Kuan-Yun
    Chen, Ho-Lin
    Iwama, Kazuo
    Liao, Chung-Shou
    Theoretical Computer Science, 2022, 938 : 86 - 96
  • [49] Sharing Economy with the Use of Car-Sharing Applications: An Empirical Study in Vietnam
    Linh Tran Cam Nguyen
    JOURNAL OF ASIAN FINANCE ECONOMICS AND BUSINESS, 2021, 8 (08): : 93 - 101
  • [50] Joint relocation and pricing in electric car-sharing systems
    Eilertsen, Ulrik
    Falck-Pedersen, Olav M.
    Henriksen, Jone, V
    Fagerholt, Kjetil
    Pantuso, Giovanni
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2024, 315 (02) : 553 - 566