CONDITIONAL SEQUENTIAL MONTE CARLO IN HIGH DIMENSIONS

被引:0
|
作者
Finke, Axel [1 ]
Thiery, Alexandre H. [1 ,2 ]
机构
[1] Loughborough Univ, Dept Math Sci, Loughborough, England
[2] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
来源
ANNALS OF STATISTICS | 2023年 / 51卷 / 02期
关键词
High dimensions; curse of dimension; Markov chain Monte Carlo; particle filter; state-space model; RANDOM-WALK METROPOLIS; UNIFORM ERGODICITY; SAMPLING METHODS; PARTICLE; ALGORITHMS;
D O I
10.1214/22-AOS2252
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The iterated conditional sequential Monte Carlo (i-CSMC) algorithm from Andrieu, Doucet and Holenstein (J. R. Stat. Soc. Ser. B Stat. Methodol. 72 (2010) 269-342) is an MCMC approach for efficiently sampling from the joint posterior distribution of the T latent states in challenging time-series models, for example, in nonlinear or non-Gaussian state-space models. It is also the main ingredient in particle Gibbs samplers which infer unknown model parameters alongside the latent states. In this work, we first prove that the i-CSMC algorithm suffers from a curse of dimension in the dimension of the states, D: it breaks down unless the number of samples ('particles'), N, proposed by the algorithm grows exponentially with D. Then we present a novel 'local' version of the algorithm which proposes particles using Gaus-sian random-walk moves that are suitably scaled with D. We prove that this it-erated random-walk conditional sequential Monte Carlo (i-RW-CSMC) algo-rithm avoids the curse of dimension: for arbitrary N, its acceptance rates and expected squared jumping distance converge to nontrivial limits as D & RARR; & INFIN;. If T = N = 1, our proposed algorithm reduces to a Metropolis-Hastings or Barker's algorithm with Gaussian random-walk moves and we recover the well-known scaling limits for such algorithms.
引用
收藏
页码:437 / 463
页数:27
相关论文
共 50 条
  • [1] ON THE STABILITY OF SEQUENTIAL MONTE CARLO METHODS IN HIGH DIMENSIONS
    Beskos, Alexandros
    Crisan, Dan
    Jasra, Ajay
    ANNALS OF APPLIED PROBABILITY, 2014, 24 (04): : 1396 - 1445
  • [2] Replica Conditional Sequential Monte Carlo
    Shestopaloff, Alexander Y.
    Doucet, Arnaud
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [4] ERROR BOUNDS AND NORMALISING CONSTANTS FOR SEQUENTIAL MONTE CARLO SAMPLERS IN HIGH DIMENSIONS
    Beskos, Alexandros
    Crisan, Dan O.
    Jasra, Ajay
    Whiteley, Nick
    ADVANCES IN APPLIED PROBABILITY, 2014, 46 (01) : 279 - 306
  • [5] Monte Carlo on manifolds in high dimensions
    Xu, Kerun
    Holmes-Cerfon, Miranda
    JOURNAL OF COMPUTATIONAL PHYSICS, 2024, 506
  • [6] Monte Carlo on manifolds in high dimensions
    Xu, Kerun
    Holmes-Cerfon, Miranda
    arXiv, 2023,
  • [7] CONDITIONAL MONTE CARLO
    HAMMERSLEY, JM
    JOURNAL OF THE ACM, 1956, 3 (02) : 73 - 76
  • [8] Population Monte Carlo Algorithm in High Dimensions
    Jeong Eun Lee
    Ross McVinish
    Kerrie Mengersen
    Methodology and Computing in Applied Probability, 2011, 13 : 369 - 389
  • [9] Monte Carlo gradient estimation in high dimensions
    Patelli, E.
    Pradlwarter, H. J.
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2010, 81 (02) : 172 - 188
  • [10] Population Monte Carlo Algorithm in High Dimensions
    Lee, Jeong Eun
    McVinish, Ross
    Mengersen, Kerrie
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2011, 13 (02) : 369 - 389