A Matching Algorithm with Reinforcement Learning and Decoupling Strategy for Order Dispatching in On-Demand Food Delivery

被引:3
|
作者
Chen, Jingfang [1 ]
Wang, Ling [1 ]
Pan, Zixiao [1 ]
Wu, Yuting [1 ]
Zheng, Jie [1 ]
Ding, Xuetao [2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Meituan, Dept Delivery Technol, Beijing 100102, Peoples R China
来源
TSINGHUA SCIENCE AND TECHNOLOGY | 2024年 / 29卷 / 02期
基金
中国国家自然科学基金;
关键词
order dispatching; on-demand delivery; reinforcement learning; decoupling strategy; sequence-to-sequence neural network; MEAL-DELIVERY;
D O I
10.26599/TST.2023.9010069
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The on-demand food delivery (OFD) service has gained rapid development in the past decades but meanwhile encounters challenges for further improving operation quality. The order dispatching problem is one of the most concerning issues for the OFD platforms, which refer to dynamically dispatching a large number of orders to riders reasonably in very limited decision time. To solve such a challenging combinatorial optimization problem, an effective matching algorithm is proposed by fusing the reinforcement learning technique and the optimization method. First, to deal with the large-scale complexity, a decoupling method is designed by reducing the matching space between new orders and riders. Second, to overcome the high dynamism and satisfy the stringent requirements on decision time, a reinforcement learning based dispatching heuristic is presented. To be specific, a sequence-tosequence neural network is constructed based on the problem characteristic to generate an order priority sequence. Besides, a training approach is specially designed to improve learning performance. Furthermore, a greedy heuristic is employed to effectively dispatch new orders according to the order priority sequence. On real-world datasets, numerical experiments are conducted to validate the effectiveness of the proposed algorithm. Statistical results show that the proposed algorithm can effectively solve the problem by improving delivery efficiency and maintaining customer satisfaction.
引用
收藏
页码:386 / 399
页数:14
相关论文
共 50 条
  • [1] Order Dispatching via GNN-Based Optimization Algorithm for On-Demand Food Delivery
    Chen, Jing-Fang
    Wang, Ling
    Liang, Yile
    Yu, Yang
    Feng, Jie
    Zhao, Jiuxia
    Ding, Xuetao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (10) : 13147 - 13162
  • [2] Reinforcement Learning-Based Dynamic Order Recommendation for On-Demand Food Delivery
    Wang, Xing
    Wang, Ling
    Dong, Chenxin
    Ren, Hao
    Xing, Ke
    TSINGHUA SCIENCE AND TECHNOLOGY, 2024, 29 (02): : 356 - 367
  • [3] An Imitation Learning-Enhanced Iterated Matching Algorithm for On-Demand Food Delivery
    Chen, Jing-Fang
    Wang, Ling
    Ren, Hao
    Pan, Jize
    Wang, Shengyao
    Zheng, Jie
    Wang, Xing
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 18603 - 18619
  • [4] Crowdsourced on-demand food delivery: An order batching and assignment algorithm
    Simoni, Michele D.
    Winkenbach, Matthias
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 149
  • [5] Integrated differentiated time slot pricing and order dispatching with uncertain customer demand in on-demand food delivery
    Zhang, Bo
    Hassini, Elkafi
    Zhou, Yun
    Zhao, Meng
    Hu, Xiangpei
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2025, 323 (02) : 471 - 489
  • [6] Learning the on-demand adaptable matching range with a reinforcement learning
    Liu, Yuhan
    Feng, Siyuan
    Bao, Yue
    Yang, Hai
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2025, 172
  • [7] Exploring Deep Reinforcement Learning for Task Dispatching in Autonomous On-Demand Services
    Yang, Lei
    Yu, Xi
    Cao, Jiannong
    Liu, Xuxun
    Zhou, Pan
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2021, 15 (03)
  • [8] Order Fulfillment Cycle Time Estimation for On-Demand Food Delivery
    Zhu, Lin
    Yu, Wei
    Zhou, Kairong
    Wang, Xing
    Feng, Wenxing
    Wang, Pengyu
    Chen, Ning
    Lee, Pei
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 2571 - 2580
  • [9] Riding Against the Algorithm: Algorithmic Management in On-Demand Food Delivery
    Tuomi, Aarni
    Jianu, Brana
    Roelofsen, Maartje
    Passos Ascencao, Mario
    INFORMATION AND COMMUNICATION TECHNOLOGIES IN TOURISM 2023, ENTER 2023, 2023, : 28 - 39
  • [10] Time-Constrained Actor-Critic Reinforcement Learning for Concurrent Order Dispatch in On-Demand Delivery
    Wang, Shuai
    Guo, Baoshen
    Ding, Yi
    Wang, Guang
    He, Suining
    Zhang, Desheng
    He, Tian
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (08) : 8175 - 8192