Stochastic control/stopping problem with expectation constraints

被引:2
|
作者
Bayraktar, Erhan [1 ]
Yao, Song [2 ]
机构
[1] Univ Michigan, Dept Math, Ann Arbor, MI 48109 USA
[2] Univ Pittsburgh, Dept Math, Pittsburgh, PA 15260 USA
基金
美国国家科学基金会;
关键词
Martingale-problem formulation; Enlarged canonical space; Polish space of diffusion controls; Polish space of stopping times; Dynamic programming principle; Regular conditional probability distribution; Measurable selection; Stochastic control/stopping problem with expectation constraints; TARGET PROBLEMS; EQUATION; DUALITY;
D O I
10.1016/j.spa.2024.104430
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study a stochastic control/stopping problem with a series of inequality-type and equalitytype expectation constraints in a general non-Markovian framework. We demonstrate that the stochastic control/stopping problem with expectation constraints (CSEC) is independent of a specific probability setting and is equivalent to the constrained stochastic control/stopping problem in weak formulation (an optimization over joint laws of Brownian motion, state dynamics, diffusion controls and stopping rules on an enlarged canonical space). Using a martingale-problem formulation of controlled SDEs in spirit of Stroock and Varadhan (2006), we characterize the probability classes in weak formulation by countably many actions of canonical processes, and thus obtain the upper semi-analyticity of the CSEC value function. Then we employ a measurable selection argument to establish a dynamic programming principle (DPP) in weak formulation for the CSEC value function, in which the conditional expected costs act as additional states for constraint levels at the intermediate horizon. This article extends (El Karoui and Tan, 2013) to the expectation-constraint case. We extend our previous work (Bayraktar and Yao, 2024) to the more complicated setting where the diffusion is controlled. Compared to that paper the topological properties of diffusion-control spaces and the corresponding measurability are more technically involved which complicate the arguments especially for the measurable selection for the super-solution side of DPP in the weak formulation.
引用
收藏
页数:37
相关论文
共 50 条
  • [1] Stochastic Optimal Control Problem with Obstacle Constraints in Sublinear Expectation Framework
    Li, Hanwu
    Wang, Falei
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 183 (02) : 422 - 439
  • [2] Stochastic Optimal Control Problem with Obstacle Constraints in Sublinear Expectation Framework
    Hanwu Li
    Falei Wang
    Journal of Optimization Theory and Applications, 2019, 183 : 422 - 439
  • [3] OPTIMAL STOPPING WITH EXPECTATION CONSTRAINTS
    Bayraktar, Erhan
    Yao, Song
    ANNALS OF APPLIED PROBABILITY, 2024, 34 (1B): : 917 - 959
  • [4] On the Stochastic Control-Stopping Problem
    El Asri, Brahim
    Hamadene, Said
    Oufdil, Khalid
    arXiv, 2020,
  • [5] On the stochastic control-stopping problem
    El Asri, Brahim
    Hamadene, Said
    Oufdil, Khalid
    JOURNAL OF DIFFERENTIAL EQUATIONS, 2022, 336 : 387 - 426
  • [6] A problem of stochastic impulse control with discretionary stopping
    Duckworth, K
    Zervos, M
    PROCEEDINGS OF THE 39TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 2000, : 222 - 227
  • [7] A PROBLEM OF SINGULAR STOCHASTIC CONTROL WITH DISCRETIONARY STOPPING
    Davis, M. H. A.
    Zervos, M.
    ANNALS OF APPLIED PROBABILITY, 1994, 4 (01): : 226 - 240
  • [8] Stopping with expectation constraints: 3 points suffice
    Ankirchner, Stefan
    Kazi-Tani, Nabil
    Klein, Maike
    Kruse, Thomas
    ELECTRONIC JOURNAL OF PROBABILITY, 2019, 24
  • [9] On Dynamic Programming Principle for Stochastic Control Under Expectation Constraints
    Yuk-Loong Chow
    Xiang Yu
    Chao Zhou
    Journal of Optimization Theory and Applications, 2020, 185 : 803 - 818
  • [10] On Dynamic Programming Principle for Stochastic Control Under Expectation Constraints
    Chow, Yuk-Loong
    Yu, Xiang
    Zhou, Chao
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2020, 185 (03) : 803 - 818