Separable dynamic programming and approximate decomposition methods

被引:12
|
作者
Bertsekas, Dimitri P. [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
关键词
dynamic programming; optical control; reachability; separable problems;
D O I
10.1109/TAC.2007.895901
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider control, planning, and resource allocation problems involving several independent subsystems that are coupled through a control/decision constraint. We discuss one-step lookahead methods that use an approximate cost-to-go function derived from the solution of single subsystem problems. We propose a new method for constructing such approximations, and derive bounds on the performance of the associated suboptimal policies. We then specialize this method to problems of reachability of target tubes that have the form of a box (a Cartesian product of subsystem tubes). We thus obtain inner approximating tubes, which are the union of a finite number of boxes, each involving single subsystem calculations.
引用
收藏
页码:911 / 916
页数:6
相关论文
共 50 条
  • [1] MULTISTAGE STOCHASTIC DECOMPOSITION: A BRIDGE BETWEEN STOCHASTIC PROGRAMMING AND APPROXIMATE DYNAMIC PROGRAMMING
    Sen, Suvrajeet
    Zhou, Zhihong
    SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (01) : 127 - 153
  • [2] Pathologies of Temporal Difference Methods in Approximate Dynamic Programming
    Bertsekas, Dimitri P.
    49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 3034 - 3039
  • [3] Post-Decision States and Separable Approximations Are Powerful Tools of Approximate Dynamic Programming
    Ruszczynski, Andrzej
    INFORMS JOURNAL ON COMPUTING, 2010, 22 (01) : 20 - 22
  • [4] Approximate Dynamic Programming using Halfspace Queries and Multiscale Monge Decomposition
    Miller, Gary L.
    Peng, Richard
    Schwartz, Russell
    Tsourakakis, Charalampos
    PROCEEDINGS OF THE TWENTY-SECOND ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2011, : 1675 - 1682
  • [5] Decentralized Bayesian search using approximate dynamic programming methods
    Zhao, Yijia
    Patek, Stephen D.
    Beling, Peter A.
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (04): : 970 - 975
  • [6] A simplified algorithm for approximate separable decomposition of morphological templates
    Singh, B
    Siddiqi, MU
    PATTERN RECOGNITION, 1996, 29 (09) : 1519 - 1522
  • [7] An Integrated Decomposition and Approximate Dynamic Programming Approach for On-Demand Ride Pooling
    Yu, Xian
    Shen, Siqian
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (09) : 3811 - 3820
  • [8] Path Planning in an Uncertain Environment Using Approximate Dynamic Programming Methods
    Bienkowski, Adam
    Sidoti, David
    Zhang, Lingyi
    Pattipati, Krishna R.
    Sampson, Charles R.
    Hansen, James
    2018 21ST INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2018, : 2542 - 2547
  • [9] Approximate dynamic programming methods for an inventory allocation problem under uncertainty
    Topaloglu, Huseyin
    Kunnumkal, Sumit
    NAVAL RESEARCH LOGISTICS, 2006, 53 (08) : 822 - 841
  • [10] Perspectives of approximate dynamic programming
    Powell, Warren B.
    ANNALS OF OPERATIONS RESEARCH, 2016, 241 (1-2) : 319 - 356