Ground Delay Program Planning Using Markov Decision Processes

被引:4
|
作者
Cox, Jonathan [1 ]
Kochenderfer, Mykel J. [1 ]
机构
[1] Stanford Univ, Dept Aeronaut & Astronaut, 496 Lomita Mall, Stanford, CA 94305 USA
来源
关键词
TRAFFIC FLOW MANAGEMENT; HOLDING PROBLEM;
D O I
10.2514/1.I010387
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper compares three approaches for selecting planned airport acceptance rates in the single-airport ground-holding problem: the Ball et al. model, the Richetta-Odoni dynamic model, and an approach based on approximate dynamic programming. Selecting planned airport acceptance rates is motivated by current practice of ground delay program planning under collaborative decision making. The approaches were evaluated using real flight schedules and landing capacity data from Newark Liberty International and San Francisco International Airports. It is shown that planned airport acceptance rates can be determined from the decision variables of the Richetta-Odoni dynamic model. The approximate dynamic programming solution, introduced by the authors, is found by posing a model that evaluates planned airport acceptance as a Markov decision process. The dynamic Richetta-Odoni and approximate dynamic programming approaches were found to produce similar solutions, and both dominated the Ball et al. model. The Richetta-Odoni dynamic model is computationally more efficient, finding solutions 10 times faster than approximate dynamic programming, although the approximate dynamic programming approach can more easily incorporate complex objectives. Surprisingly, the performance of all three approaches did not change significantly when evaluated using different models for collaborative decision-making procedures. This observation suggests that modeling collaborative decision making may not be important for selecting near-optimal planned airport acceptance rates.
引用
收藏
页码:134 / 142
页数:9
相关论文
共 50 条
  • [21] Optimizing marketing planning and budgeting using Markov decision processes: An airline case study
    Labbi, A.
    Berrospi, C.
    IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2007, 51 (3-4) : 421 - 431
  • [22] Planning in Discrete and Continuous Markov Decision Processes by Probabilistic Programming
    Nitti, Davide
    Belle, Vaishak
    de Raedt, Luc
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2015, PT II, 2015, 9285 : 327 - 342
  • [23] Online Planning for Large Markov Decision Processes with Hierarchical Decomposition
    Bai, Aijun
    Wu, Feng
    Chen, Xiaoping
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2015, 6 (04)
  • [24] Robust Adaptive Markov Decision Processes PLANNING WITH MODEL UNCERTAINTY
    Bertuccelli, Luca F.
    Wu, Albert
    How, Jonathan P.
    IEEE CONTROL SYSTEMS MAGAZINE, 2012, 32 (05): : 96 - 109
  • [25] Optimistic Planning for Belief-Augmented Markov Decision Processes
    Fonteneau, Raphael
    Busoniu, Lucian
    Munos, Remi
    PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2013, : 77 - 84
  • [26] Learning and Planning in Average-Reward Markov Decision Processes
    Wan, Yi
    Naik, Abhishek
    Sutton, Richard S.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139 : 7665 - 7676
  • [27] Planning in entropy-regularized Markov decision processes and games
    Grill, Jean-Bastien
    Domingues, Omar D.
    Menard, Pierre
    Munos, Remi
    Valko, Michal
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [28] Simple Regret Optimization in Online Planning for Markov Decision Processes
    Feldman, Zohar
    Domshlak, Carmel
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2014, 51 : 165 - 205
  • [29] A Linearly Relaxed Approximate Linear Program for Markov Decision Processes
    Lakshminarayanan, Chandrashekar
    Bhatnagar, Shalabh
    Szepesvari, Csaba
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (04) : 1185 - 1191
  • [30] Ground delay program planning under uncertainty in airport capacity
    Mukherjee, Avijit
    Hansen, Mark
    Grabbe, Shon
    TRANSPORTATION PLANNING AND TECHNOLOGY, 2012, 35 (06) : 611 - 628