Dynamic programming for multidimensional stochastic control problems

被引:10
|
作者
Ma, J [1 ]
Yong, J
机构
[1] Purdue Univ, Dept Math, W Lafayette, IN 47907 USA
[2] Fudan Univ, Dept Math, Lab Math Nonlinear Sci, Shanghai 200433, Peoples R China
[3] Fudan Univ, Inst Math Finance, Shanghai 200433, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
stochastic control; dynamic programming; viscosity solutions; singular control; impulse control;
D O I
10.1007/s10114-999-0081-5
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper we study a general multidimensional diffusion-type stochastic control problem. Our model contains the usual regular control problem, singular control problem and impulse control problem as special cases. Using a unified treatment of dynamic programming, we show that the value function of the problem is a viscosity solution of certain Hamilton-Jacobi-Bellman (HJB) quasivariational inequality. The uniqueness of such a quasi-variational inequality is proved.
引用
收藏
页码:485 / 506
页数:22
相关论文
共 50 条
  • [41] DYNAMIC-PROGRAMMING AND STOCHASTIC CONTROL - BERTSEKAS,DP
    WHITE, CC
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1977, 7 (10): : 758 - 759
  • [42] Dynamic programming equations for discounted constrained stochastic control
    Chen, RC
    Blankenship, GL
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2004, 49 (05) : 699 - 709
  • [43] Control of sensory perception using stochastic dynamic programming
    Hovland, GE
    McCarragher, BJ
    ADFS-96 - FIRST AUSTRALIAN DATA FUSION SYMPOSIUM, 1996, : 196 - 201
  • [44] AN ALGORITHM FOR STOCHASTIC CONTROL THROUGH DYNAMIC PROGRAMMING TECHNIQUES
    CHEN, PP
    IRE TRANSACTIONS ON AUTOMATIC CONTROL, 1962, AC 7 (05): : 110 - &
  • [46] DYNAMIC-PROGRAMMING AND STOCHASTIC CONTROL - BERTSEKAS,DP
    VICKSON, RG
    INTERFACES, 1978, 8 (02) : 109 - 111
  • [47] Multidimensional Dual Dynamic Programming
    E. Galewska
    A. Nowakowski
    Journal of Optimization Theory and Applications, 2005, 124 : 175 - 186
  • [48] Multidimensional dual dynamic programming
    Galewska, E
    Nowakowski, A
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2005, 124 (01) : 175 - 186
  • [49] Dynamic consistency for stochastic optimal control problems
    Pierre Carpentier
    Jean-Philippe Chancelier
    Guy Cohen
    Michel De Lara
    Pierre Girardeau
    Annals of Operations Research, 2012, 200 : 247 - 263
  • [50] Dynamic consistency for stochastic optimal control problems
    Carpentier, Pierre
    Chancelier, Jean-Philippe
    Cohen, Guy
    De Lara, Michel
    Girardeau, Pierre
    ANNALS OF OPERATIONS RESEARCH, 2012, 200 (01) : 247 - 263