Semi-Markov and reward fields

被引：1

作者：

Soltani, A. R. ^{[1
,2
]}

Ghasemi, H. ^{[3
]}

机构：

[1] Kuwait Univ, Coll Sci, Dept Stat & Operat Res, Kuwait, Kuwait

[2] Shiraz Univ, Coll Sci, Dept Stat, Shiraz, Iran

[3] Amirkabir Univ, Fac Math & Comp Sci, Tehran, Iran

来源：

STATISTICS & PROBABILITY LETTERS | 2014年 / 95卷

关键词：

Markov renewal fields; Markov renewal sequences; Semi Markov fields; Reward fields; Expected reward fields;

D O I：

10.1016/j.spl.2014.08.012

中图分类号：

O21 [概率论与数理统计]; C8 [统计学];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

We introduce semi-Markov fields and provide formulations for the basic terms in the semi-Markov theory. In particular we define and consider a class of associated reward fields. Then we present a formula for the expected reward at any multidimensional time epoch. The formula is indeed new even for the classical semi-Markov processes. It gives the expected cumulative reward for fairly large classes of reward functions; in particular, it provides the formulas for the expected cumulative reward given in Masuda and Sumitau (1991), Soltani (1996) and Soltani and Khorshidian (1998). (C) 2014 Elsevier B.V. All rights reserved.

引用

页码：71 / 76

页数：6

共 50 条

[31] ON SEMI-MARKOV PROCESSES
FELLER, W
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1964, 51 (04) : 653 - &
[32] Some reward paths in semi-markov models with stochastic selection of the transition probabilities
Papadopoulou, Aleka
Tsaklidis, George
METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2007, 9 (03) : 399 - 411
[33] Total Reward Semi-Markov Mean-Field Games with Complementarity Properties
Wiecek, Piotr
DYNAMIC GAMES AND APPLICATIONS, 2017, 7 (03) : 507 - 529
[34] A Unified Approach for Semi-Markov Decision Processes with Discounted and Average Reward Criteria
Li, Yanjie
Wang, Huijing
Chen, Haoyao
2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 1741 - 1744
[35] RELATIVE VALUE ITERATION FOR AVERAGE REWARD SEMI-MARKOV CONTROL VIA SIMULATION
Gosavi, Abhijit
2013 WINTER SIMULATION CONFERENCE (WSC), 2013, : 623 - 630
[36] A NON-HOMOGENEOUS SEMI-MARKOV REWARD MODEL FOR THE CREDIT SPREAD COMPUTATION
D'Amico, Guglielmo
Janssen, Jacques
Manca, Raimondo
INTERNATIONAL JOURNAL OF THEORETICAL AND APPLIED FINANCE, 2011, 14 (02) : 221 - 238
[37] Estimation for Discrete-time Semi-Markov Reward Processes: Analysis and Inference
K. Khorshidian
F. Negahdari
H. A. Mardnifard
Methodology and Computing in Applied Probability, 2016, 18 : 885 - 900
[38] Solving semi-Markov decision problems using average reward reinforcement learning
Das, TK
Gosavi, A
Mahadevan, S
Marchalleck, N
MANAGEMENT SCIENCE, 1999, 45 (04) : 560 - 574
[39] Attainability for Markov and Semi-Markov Chains
Verbeken, Brecht
Guerry, Marie-Anne
MATHEMATICS, 2024, 12 (08)
[40] Solving semi-Markov decision problems using average reward reinforcement learning
Dept. Indust. and Mgmt. Syst. Eng., University of South Florida, Tampa, FL 33620, United States
不详
不详
Manage Sci, 4 (560-574):

← 1 2 3 4 5 →