Separable dynamic programming and approximate decomposition methods

被引:12
|
作者
Bertsekas, Dimitri P. [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
关键词
dynamic programming; optical control; reachability; separable problems;
D O I
10.1109/TAC.2007.895901
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider control, planning, and resource allocation problems involving several independent subsystems that are coupled through a control/decision constraint. We discuss one-step lookahead methods that use an approximate cost-to-go function derived from the solution of single subsystem problems. We propose a new method for constructing such approximations, and derive bounds on the performance of the associated suboptimal policies. We then specialize this method to problems of reachability of target tubes that have the form of a box (a Cartesian product of subsystem tubes). We thus obtain inner approximating tubes, which are the union of a finite number of boxes, each involving single subsystem calculations.
引用
收藏
页码:911 / 916
页数:6
相关论文
共 50 条
  • [41] Approximate dynamic programming based on expansive projections
    Arruda, Edilson R.
    do Val, Joao B. R.
    PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, : 5540 - +
  • [42] ADPTriage: Approximate Dynamic Programming for Bug Triage
    Jahanshahi H.
    Cevik M.
    Mousavi K.
    Basar A.
    IEEE Transactions on Software Engineering, 2023, 49 (10) : 4594 - 4609
  • [43] Approximate dynamic programming approach for process control
    Lee, Jay H.
    Wong, Weechin
    JOURNAL OF PROCESS CONTROL, 2010, 20 (09) : 1038 - 1048
  • [44] Approximate Dynamic Programming of Continuous Annealing process
    Zhang, Yingwei
    Guo, Chao
    Chen, Xue
    Teng, Yongdong
    2009 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS ( ICAL 2009), VOLS 1-3, 2009, : 353 - 358
  • [45] Markdown Optimization via Approximate Dynamic Programming
    Cosgun, Ozlem
    Kula, Ufuk
    Kahraman, Cengiz
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2013, 6 (01) : 64 - 78
  • [46] The RBF neural network in approximate dynamic programming
    Ster, B
    Dobnikar, A
    ARTIFICIAL NEURAL NETS AND GENETIC ALGORITHMS, 1999, : 161 - 165
  • [47] Empirical Policy Iteration for Approximate Dynamic Programming
    Haskell, William B.
    Jain, Rahul
    Kalathil, Dileep
    2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 6573 - 6578
  • [48] Sampled fictitious play for approximate dynamic programming
    Epelman, Marina
    Ghate, Archis
    Smith, Robert L.
    COMPUTERS & OPERATIONS RESEARCH, 2011, 38 (12) : 1705 - 1718
  • [49] Intelligent Questionnaires Using Approximate Dynamic Programming
    Logé F.
    Le Pennec E.
    Amadou-Boubacar H.
    i-com, 2021, 19 (03) : 227 - 237
  • [50] Approximate Dynamic Programming via Penalty Functions
    Beuchat, Paul N.
    Lygeros, John
    IFAC PAPERSONLINE, 2017, 50 (01): : 11814 - 11821