A note on the passage time of finite-state Markov chains

被引:3
|
作者
Hong, Wenming [1 ,2 ]
Zhou, Ke [3 ]
机构
[1] Beijing Normal Univ, Sch Math Sci, Beijing, Peoples R China
[2] Beijing Normal Univ, Lab Math & Complex Syst, Beijing, Peoples R China
[3] Univ Int Business & Econ, Sch Stat, Beijing 100029, Peoples R China
关键词
Absorbing time; Eigenvalues; Generation functions; Laplace transforms; Markov chain; Stationary distribution; Passage time; STRONG STATIONARY TIMES; HITTING TIMES; INTERLACING EIGENVALUES; SKIP-FREE; DUALITY; PROOF;
D O I
10.1080/03610926.2014.995825
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Consider a Markov chain with finite state {0, 1, ..., d}. We give the generation functions (or Laplace transforms) of absorbing (passage) time in the following two situations: (1) the absorbing time of state d when the chain starts from any state i and absorbing at state d; (2) the passage time of any state i when the chain starts from the stationary distribution supposed the chain is time reversible and ergodic. Example shows that it is more convenient compared with the existing methods, especially we can calculate the expectation of the absorbing time directly.
引用
收藏
页码:438 / 445
页数:8
相关论文
共 50 条
  • [21] APPLICATION OF FUNCTIONS OF FINITE-STATE MARKOV CHAINS TO COMMUNICATION CHANNELS WITH MEMORY
    FRITCHMA.BD
    ANNALS OF MATHEMATICAL STATISTICS, 1965, 36 (05): : 1599 - &
  • [22] Simplified Analysis of HARQ Cooperative Networks Using Finite-State Markov Chains
    Maliqi, Faton
    Bassi, Francesca
    Duhamel, Pierre
    Limani, Ilir
    2017 25TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2017, : 2006 - 2010
  • [23] A note on external uniformization for finite markov chains in continuous time
    Kijima, Masaaki
    Probability in the Engineering and Informational Sciences, 1992, 6 (01) : 127 - 131
  • [24] PASSAGE-TIME GENERATING FUNCTIONS FOR CONTINUOUS-TIME FINITE MARKOV CHAINS
    DARROCH, JN
    MORRIS, KW
    JOURNAL OF APPLIED PROBABILITY, 1968, 5 (02) : 414 - &
  • [25] Tighter Bounds on the Capacity of Finite-State Channels Via Markov Set-Chains
    Chen, Jun
    Permuter, Haim
    Weissman, Tsachy
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 57 (08) : 3660 - 3691
  • [26] LOGARITHM FUNCTION FOR FINITE-STATE MARKOV SEMIGROUPS
    CUTHBERT, JR
    JOURNAL OF THE LONDON MATHEMATICAL SOCIETY-SECOND SERIES, 1973, 6 (MAY): : 524 - 532
  • [27] NOTE ON FINITE HOMOGENEOUS CONTINUOUS-TIME MARKOV-CHAINS
    TAVARE, S
    BIOMETRICS, 1979, 35 (04) : 831 - 834
  • [28] Finite-state Markov modeling of fading channels
    Sadeghi, Parastoo
    Kennedy, Rodney A.
    Rapajic, Predrag B.
    Shams, Ramtin
    IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (05) : 57 - 80
  • [29] The capacity of finite-state Markov channels with feedback
    Chen, J
    Berger, T
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (03) : 780 - 798
  • [30] Finite-State Markov Model for the Aeronautical Channel
    Pan, Qunhua
    Liu, Shanjian
    Xu, Ming
    Jia, Changsheng
    2009 5TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-8, 2009, : 2415 - 2418