Variational Bayesian Methods for Cognitive Science

被引:6
|
作者
Galdo, Matthew [1 ]
Bahg, Giwon [1 ]
Turner, Brandon M. [1 ]
机构
[1] Ohio State Univ, Dept Psychol, 1827 Neil Ave, Columbus, OH 43210 USA
关键词
variational Bayes; differential evolution; linear response variational Bayes; linear ballistic accumulator; cognitive modeling; CHAIN MONTE-CARLO; DIFFERENTIAL EVOLUTION; PARAMETER-ESTIMATION; DECISION-PROCESSES; RESPONSE-TIME; INFERENCE; MODEL; TUTORIAL; CHOICE; CATEGORIZATION;
D O I
10.1037/met0000242
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Bayesian inference has become a powerful and popular technique for understanding psychological phenomena. However, compared with frequentist statistics, current methods employing Bayesian statistics typically require time-intensive computations, often hindering our ability to evaluate alternatives in a thorough manner. In this article, we advocate for an alternative strategy for performing Bayesian inference, called variational Bayes (VB). VB methods posit a parametric family of distributions that could conceivably contain the target posterior distribution, and then attempt to identify the best parameters for matching the target. In this sense, acquiring the posterior becomes an optimization problem, rather than a complex integration problem. VB methods have enjoyed considerable success in fields such as neuroscience and machine learning, yet have received surprisingly little attention in fields such as psychology. Here, we identify and discuss both the advantages and disadvantages of using VB methods. In our consideration of possible strategies to make VB methods appropriate for psychological models, we develop the differential evolution variational inference algorithm, and compare its performance with a widely used VB algorithm. As test problems, we evaluate the algorithms on their ability to recover the posterior distribution of the linear ballistic accumulator model and a hierarchical signal detection model. Although we cannot endorse VB methods in their current form as a complete replacement for conventional methods, we argue that their accuracy and speed warrant inclusion within the cognitive scientist's toolkit. Translational Abstract Bayesian statistics is an alternative statistical framework that has become popular for understanding psychological phenomena. In contrast to the point estimates and confidence intervals of classical statistics, the Bayesian framework provides a distribution (the posterior) that describes our uncertainty about the parameters of interest. Rarely are there closed-form solutions for deriving the posterior, and therefore Bayesians typically rely on computational methods to approximate it. The time-intensive nature of these computational methods can prohibit the application of Bayesian framework. In this article, we advocate for an alternative, and often more efficient, strategy for performing Bayesian inference called variational Bayes (VB). VB methods make assumptions about the functional form of the posterior distribution, and then systematically morph the approximating function's parameters so that it best matches the target posterior. VB methods have enjoyed considerable success in fields such as neuroscience and machine learning, yet have received surprisingly little attention in fields such as psychology. Here, we identify and discuss both the advantages and disadvantages of using VB methods in reference to conventional posterior approximation methods. We investigate a series of algorithmic components to see which, if any, of these components can be packaged into a general purpose algorithm for problems often encountered when fitting psychological models to data by testing them on two popular models from psychology. Although we cannot endorse VB methods in their current form as a complete replacement for conventional methods, we argue that their accuracy and speed warrant inclusion within the cognitive scientist's toolkit.
引用
收藏
页码:535 / 559
页数:25
相关论文
共 50 条
  • [21] Bayesian cognitive science, predictive brains, and the nativism debate
    Colombo, Matteo
    SYNTHESE, 2018, 195 (11) : 4817 - 4838
  • [22] Bayesian cognitive science, predictive brains, and the nativism debate
    Matteo Colombo
    Synthese, 2018, 195 : 4817 - 4838
  • [23] VARIATIONAL METHODS IN MATHEMATICS, SCIENCE AND ENGINEERING - REKTORYS,K
    VIANO, G
    SCIENTIA, 1978, 113 (9-12): : 17 - 18
  • [24] Editorial: Methods and applications in cognitive science
    Padakannaya, Prakash
    Puvia, Elisa
    Khalil, Radwa
    FRONTIERS IN PSYCHOLOGY, 2023, 14
  • [25] Bayesian and Variational Methods for Discontinuity Detection: Theory Overview and Performance Comparison
    Benciolini, Battista
    Reguzzoni, Mirko
    Venuti, Giovanna
    Vitti, Alfonso
    VII HOTINE-MARUSSI SYMPOSIUM ON MATHEMATICAL GEODESY, 2012, 137
  • [26] ESTIMATION OF NAVIGATION PERFORMANCE AND OFFSET BY THE EM ALGORITHM AND THE VARIATIONAL BAYESIAN METHODS
    Fujita, Masato
    ADVANCES AND APPLICATIONS IN STATISTICS, 2013, 35 (01) : 1 - 27
  • [27] Variational Bayesian Inference Based Cooperative Spectrum Sensing in Cognitive Radio Networks
    Wu, Ming
    Song, Tiecheng
    Shen, Lianfeng
    Jia, Ziyan
    2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE), 2014, : 108 - 109
  • [28] The imaginary fundamentalists: The unshocking truth about Bayesian cognitive science
    Chater, Nick
    Goodman, Noah
    Griffiths, Thomas L.
    Kemp, Charles
    Oaksford, Mike
    Tenenbaum, Joshua B.
    BEHAVIORAL AND BRAIN SCIENCES, 2011, 34 (04) : 194 - +
  • [29] Variational Bayesian GAN
    Chien, Jen-Tzung
    Kuo, Chun-Lin
    2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [30] Variational Bayesian Unlearning
    Quoc Phong Nguyen
    Low, Bryan Kian Hsiang
    Jaillet, Patrick
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33