Distributed Bayesian Estimation of Linear Models With Unknown Observation Covariances

被引:13
|
作者
Wang, Yunlong [1 ,2 ]
Djuric, Petar M. [1 ,3 ]
机构
[1] SUNY Stony Brook, Dept Elect & Comp Engn, Stony Brook, NY 11794 USA
[2] Univ Minnesota, Dept Elect & Comp Engn, Minneapolis, MN 55455 USA
[3] Univ Minnesota, Digital Technol Ctr, Minneapolis, MN 55455 USA
关键词
Bayesian inference; distributed estimation; linear model; covariance estimation; average consensus; CONSENSUS; NETWORKS; ALGORITHMS; AVERAGE; SQUARES;
D O I
10.1109/TSP.2015.2488581
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we address the problem of distributed Bayesian estimation in networks of agents over a given undirected graph. The agents observe data represented by a general linear model with unknown covariance matrices. The agents try to reach consensus on the belief on the unknown linear parameters based on their private signals and information provided by their neighbors. The belief is defined by the posterior distribution of the parameters. After deriving the Bayesian belief held by a fictitious fusion center, we present a consensus-based solution where the agents reach the belief of the fusion center. According to our scheme, at every time instant, each agent carries out three operations: a) receives private noisy measurements; b) exchanges information about its belief with its neighbors; and c) updates its belief with the new information. We show that with the proposed method, the Kullback-Leibler divergence between the beliefs of the agents and the fusion center converges to zero. We demonstrate the performance of the method by computer simulations.
引用
收藏
页码:1962 / 1971
页数:10
相关论文
共 50 条
  • [1] Consensus variational Bayesian moving horizon estimation for distributed sensor networks with unknown noise covariances
    Dong, Xiangxiang
    Battistelli, Giorgio
    Chisci, Luigi
    Cai, Yunze
    SIGNAL PROCESSING, 2022, 198
  • [2] Bayesian Cramer-Rao Bound for Distributed Vector Estimation with Linear Observation Model
    Shirazi, Mojtaha
    Vosoughi, Azadeh
    2014 IEEE 25TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATION (PIMRC), 2014, : 712 - 716
  • [3] Restricted maximum likelihood estimation of covariances in sparse linear models
    Neumaier, A
    Groeneveld, E
    GENETICS SELECTION EVOLUTION, 1998, 30 (01) : 3 - 26
  • [4] STATE ESTIMATION FOR LINEAR DISCRETE-TIME-SYSTEMS WITH UNKNOWN NOISE COVARIANCES
    TUGNAIT, JK
    HADDAD, AH
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1979, 24 (02) : 337 - 340
  • [5] Restricted maximum likelihood estimation of covariances in sparse linear models
    Arnold Neumaier
    Eildert Groeneveld
    Genetics Selection Evolution, 30 (1)
  • [6] Estimation of temporal covariances in pathogen dynamics using Bayesian multivariate autoregressive models
    Mair, Colette
    Nickbakhsh, Sema
    Reeve, Richard
    McMenamin, Jim
    Reynolds, Arlene
    Gunson, Rory N.
    Murcia, Pablo R.
    Matthews, Louise
    PLOS COMPUTATIONAL BIOLOGY, 2019, 15 (12)
  • [7] On Distributed Linear Estimation With Observation Model Uncertainties
    Sani, Alireza
    Vosoughi, Azadeh
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (12) : 3212 - 3227
  • [8] Distributed Bayesian Piecewise Sparse Linear Models
    Asahara, Masato
    Fujimaki, Ryohei
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 883 - 888
  • [9] Distributed Estimation of Sparse Inverse Covariances
    Yao, Tong
    Sundaram, Shreyas
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 4077 - 4082
  • [10] Linear coherent distributed estimation over unknown channels
    Wu, Chien-Hsien
    Lin, Ching-An
    SIGNAL PROCESSING, 2011, 91 (04) : 1000 - 1011