Separable dynamic programming and approximate decomposition methods

被引:12
|
作者
Bertsekas, Dimitri P. [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
关键词
dynamic programming; optical control; reachability; separable problems;
D O I
10.1109/TAC.2007.895901
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider control, planning, and resource allocation problems involving several independent subsystems that are coupled through a control/decision constraint. We discuss one-step lookahead methods that use an approximate cost-to-go function derived from the solution of single subsystem problems. We propose a new method for constructing such approximations, and derive bounds on the performance of the associated suboptimal policies. We then specialize this method to problems of reachability of target tubes that have the form of a box (a Cartesian product of subsystem tubes). We thus obtain inner approximating tubes, which are the union of a finite number of boxes, each involving single subsystem calculations.
引用
收藏
页码:911 / 916
页数:6
相关论文
共 50 条
  • [31] On approximate dynamic programming in switching systems
    Rantzer, Anders
    2005 44TH IEEE CONFERENCE ON DECISION AND CONTROL & EUROPEAN CONTROL CONFERENCE, VOLS 1-8, 2005, : 1391 - 1396
  • [32] Approximate Dynamic Programming for Ambulance Redeployment
    Maxwell, Matthew S.
    Restrepo, Mateo
    Henderson, Shane G.
    Topaloglu, Huseyin
    INFORMS JOURNAL ON COMPUTING, 2010, 22 (02) : 266 - 281
  • [33] Decomposition methods in stochastic programming
    Ruszczynski, Andrzej
    Mathematical Programming, Series B, 1997, 79 (1-3): : 333 - 353
  • [34] An Approximate Dynamic Programming Approach to Dynamic Stochastic Matching
    You, Fan
    Vossen, Thomas
    INFORMS JOURNAL ON COMPUTING, 2024, 36 (04) : 1006 - 1022
  • [35] Decentralized approximate dynamic programming for dynamic networks of agents
    Lakshmanan, Hariharan
    Pucci de Farias, Daniela
    2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2006, 1-12 : 1648 - +
  • [36] Decomposition methods in stochastic programming
    Andrzej Ruszczyński
    Mathematical Programming, 1997, 79 : 333 - 353
  • [37] Decomposition methods in stochastic programming
    Ruszczynski, A
    MATHEMATICAL PROGRAMMING, 1997, 79 (1-3) : 333 - 353
  • [38] On constraint sampling in the linear programming approach to approximate dynamic programming
    de Farias, DP
    Van Roy, B
    MATHEMATICS OF OPERATIONS RESEARCH, 2004, 29 (03) : 462 - 478
  • [39] On decomposition methods for a class of partially separable nonlinear programs
    DeMiguel, Victor
    Nogales, Francisco J.
    MATHEMATICS OF OPERATIONS RESEARCH, 2008, 33 (01) : 119 - 139
  • [40] Alleviating tuning sensitivity in Approximate Dynamic Programming
    Beuchat, Paul
    Georghiou, Angelos
    Lygeros, John
    2016 EUROPEAN CONTROL CONFERENCE (ECC), 2016, : 1616 - 1622