Separable dynamic programming and approximate decomposition methods

被引:12
|
作者
Bertsekas, Dimitri P. [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
关键词
dynamic programming; optical control; reachability; separable problems;
D O I
10.1109/TAC.2007.895901
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider control, planning, and resource allocation problems involving several independent subsystems that are coupled through a control/decision constraint. We discuss one-step lookahead methods that use an approximate cost-to-go function derived from the solution of single subsystem problems. We propose a new method for constructing such approximations, and derive bounds on the performance of the associated suboptimal policies. We then specialize this method to problems of reachability of target tubes that have the form of a box (a Cartesian product of subsystem tubes). We thus obtain inner approximating tubes, which are the union of a finite number of boxes, each involving single subsystem calculations.
引用
收藏
页码:911 / 916
页数:6
相关论文
共 50 条
  • [21] Approximate Dynamic Programming via Sum of Squares Programming
    Summers, Tyler H.
    Kunz, Konstantin
    Kariotoglou, Nikolaos
    Kamgarpour, Maryam
    Summers, Sean
    Lygeros, John
    2013 EUROPEAN CONTROL CONFERENCE (ECC), 2013, : 191 - 197
  • [22] Separable approximations and decomposition methods for the augmented Lagrangian
    Tappenden, Rachael
    Richatrik, Peter
    Bueke, Burak
    OPTIMIZATION METHODS & SOFTWARE, 2015, 30 (03): : 643 - 668
  • [23] Approximate dynamic programming with Gaussian processes
    Deisenroth, Marc P.
    Peters, Jan
    Rasmussen, Carl E.
    2008 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2008, : 4480 - +
  • [24] Approximate dynamic programming for sensor management
    Castanon, DA
    PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 1997, : 1202 - 1207
  • [25] Dynamic Programming for Approximate Expansion Algorithm
    Veksler, Olga
    COMPUTER VISION - ECCV 2012, PT III, 2012, 7574 : 850 - 863
  • [26] Approximate dynamic programming for stochastic reachability
    Kariotoglou, Nikolaos
    Summers, Sean
    Summers, Tyler
    Kamgarpour, Maryam
    Lygeros, John
    2013 EUROPEAN CONTROL CONFERENCE (ECC), 2013, : 584 - 589
  • [27] Approximate dynamic programming for container stacking
    Boschma, Rene
    Mes, Martijn R. K.
    de Vries, Leon R.
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2023, 310 (01) : 328 - 342
  • [28] Feature Discovery in Approximate Dynamic Programming
    Preux, Philippe
    Girgin, Sertan
    Loth, Manuel
    ADPRL: 2009 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING, 2009, : 109 - +
  • [29] Approximate dynamic programming with a fuzzy parameterization
    Busoniu, Lucian
    Ernst, Damien
    De Schutter, Bart
    Babuska, Robert
    AUTOMATICA, 2010, 46 (05) : 804 - 814
  • [30] Bayesian Exploration for Approximate Dynamic Programming
    Ryzhov, Ilya O.
    Mes, Martijn R. K.
    Powell, Warren B.
    van den Berg, Gerald
    OPERATIONS RESEARCH, 2019, 67 (01) : 198 - 214