Sparse Bayesian Estimation of Parameters in Linear-Gaussian State-Space Models

被引:3
|
作者
Cox, Benjamin [1 ]
Elvira, Victor [1 ]
机构
[1] Univ Edinburgh, Sch Math, Edinburgh EH9 3FD, Scotland
基金
英国自然环境研究理事会;
关键词
Bayesian methods; graphical inference; Kalman filtering; Markov chain Monte Carlo; parameter estimation; sparsity detection; state-space modelling; REVERSIBLE-JUMP; WEAK-CONVERGENCE; PARTICLE FILTER; SELECTION; ALGORITHM; INFERENCE; DECOMPOSITION; COMPUTATION; LIKELIHOOD;
D O I
10.1109/TSP.2023.3278867
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
State-space models (SSMs) are a powerful statistical tool for modelling time-varying systems via a latent state. In these models, the latent state is never directly observed. Instead, a sequence of data points related to the state are obtained. The linear-Gaussian state-space model is widely used, since it allows for exact inference when all model parameters are known, however this is rarely the case. The estimation of these parameters is a very challenging but essential task to perform inference and prediction. In the linear-Gaussian model, the state dynamics are described via a state transition matrix. This model parameter is known to behard to estimate, since it encodes the relationships between the state elements, which are never observed. In many applications, this transition matrix is sparse since not all state components directly affect all other state components. However, most parameter estimation methods do not exploit this feature. In this work we propose SpaRJ, a fully probabilistic Bayesian approach that obtains sparse samples from the posterior distribution of the transition matrix. Our method explores sparsity by traversing a set of models that exhibit differing sparsity patterns in the transition matrix. Moreover, we also design new effective rules to explore transition matrices within the same level of sparsity. This novel methodology has strong theoretical guarantees, and unveils the latent structure of the data generating process, thereby enhancing interpretability. The performance of SpaRJ is showcased in example with dimension 144 in the parameter space, and in a numerical example with real data.
引用
收藏
页码:1922 / 1937
页数:16
相关论文
共 50 条
  • [21] State-space models' dirty little secrets: even simple linear Gaussian models can have estimation problems
    Auger-Methe, Marie
    Field, Chris
    Albertsen, Christoffer M.
    Derocher, Andrew E.
    Lewis, Mark A.
    Jonsen, Ian D.
    Flemming, Joanna Mills
    SCIENTIFIC REPORTS, 2016, 6
  • [22] State-space models’ dirty little secrets: even simple linear Gaussian models can have estimation problems
    Marie Auger-Méthé
    Chris Field
    Christoffer M. Albertsen
    Andrew E. Derocher
    Mark A. Lewis
    Ian D. Jonsen
    Joanna Mills Flemming
    Scientific Reports, 6
  • [23] Fully Bayesian analysis of conditionally linear Gaussian state space models
    Doucet, A
    Duvaut, P
    1996 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, CONFERENCE PROCEEDINGS, VOLS 1-6, 1996, : 2948 - 2951
  • [24] Efficient estimation of conditionally linear and Gaussian state space models
    Moura, Guilherme V.
    Turatti, Douglas Eduardo
    ECONOMICS LETTERS, 2014, 124 (03) : 494 - 499
  • [25] Procedures of Parameters' estimation of AR(1) models into lineal state-space models
    Noomene, Rouhia
    WORLD CONGRESS ON ENGINEERING 2007, VOLS 1 AND 2, 2007, : 995 - 999
  • [26] Variational Gaussian Process State-Space Models
    Frigola, Roger
    Chen, Yutian
    Rasmussen, Carl E.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [27] The Gaussian multiplicative approximation for state-space models
    Deka, Bhargob
    Nguyen, Luong Ha
    Amiri, Saeid
    Goulet, James-A
    STRUCTURAL CONTROL & HEALTH MONITORING, 2022, 29 (03):
  • [28] Output grouping using Dirichlet Mixtures of Linear Gaussian State-Space models
    Chiappa, Silvia
    Barber, David
    PROCEEDINGS OF THE 5TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2007, : 446 - +
  • [29] Bayesian Tire-Friction Learning by Gaussian-Process State-Space Models
    Berntorp, Karl
    2019 18TH EUROPEAN CONTROL CONFERENCE (ECC), 2019, : 231 - 236
  • [30] Online Constrained Bayesian Inference and Learning of Gaussian-Process State-Space Models
    Berntorp, Karl
    Menner, Marcel
    2022 AMERICAN CONTROL CONFERENCE, ACC, 2022, : 940 - 945