Variational Bayesian Methods for Cognitive Science

被引:6
|
作者
Galdo, Matthew [1 ]
Bahg, Giwon [1 ]
Turner, Brandon M. [1 ]
机构
[1] Ohio State Univ, Dept Psychol, 1827 Neil Ave, Columbus, OH 43210 USA
关键词
variational Bayes; differential evolution; linear response variational Bayes; linear ballistic accumulator; cognitive modeling; CHAIN MONTE-CARLO; DIFFERENTIAL EVOLUTION; PARAMETER-ESTIMATION; DECISION-PROCESSES; RESPONSE-TIME; INFERENCE; MODEL; TUTORIAL; CHOICE; CATEGORIZATION;
D O I
10.1037/met0000242
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Bayesian inference has become a powerful and popular technique for understanding psychological phenomena. However, compared with frequentist statistics, current methods employing Bayesian statistics typically require time-intensive computations, often hindering our ability to evaluate alternatives in a thorough manner. In this article, we advocate for an alternative strategy for performing Bayesian inference, called variational Bayes (VB). VB methods posit a parametric family of distributions that could conceivably contain the target posterior distribution, and then attempt to identify the best parameters for matching the target. In this sense, acquiring the posterior becomes an optimization problem, rather than a complex integration problem. VB methods have enjoyed considerable success in fields such as neuroscience and machine learning, yet have received surprisingly little attention in fields such as psychology. Here, we identify and discuss both the advantages and disadvantages of using VB methods. In our consideration of possible strategies to make VB methods appropriate for psychological models, we develop the differential evolution variational inference algorithm, and compare its performance with a widely used VB algorithm. As test problems, we evaluate the algorithms on their ability to recover the posterior distribution of the linear ballistic accumulator model and a hierarchical signal detection model. Although we cannot endorse VB methods in their current form as a complete replacement for conventional methods, we argue that their accuracy and speed warrant inclusion within the cognitive scientist's toolkit. Translational Abstract Bayesian statistics is an alternative statistical framework that has become popular for understanding psychological phenomena. In contrast to the point estimates and confidence intervals of classical statistics, the Bayesian framework provides a distribution (the posterior) that describes our uncertainty about the parameters of interest. Rarely are there closed-form solutions for deriving the posterior, and therefore Bayesians typically rely on computational methods to approximate it. The time-intensive nature of these computational methods can prohibit the application of Bayesian framework. In this article, we advocate for an alternative, and often more efficient, strategy for performing Bayesian inference called variational Bayes (VB). VB methods make assumptions about the functional form of the posterior distribution, and then systematically morph the approximating function's parameters so that it best matches the target posterior. VB methods have enjoyed considerable success in fields such as neuroscience and machine learning, yet have received surprisingly little attention in fields such as psychology. Here, we identify and discuss both the advantages and disadvantages of using VB methods in reference to conventional posterior approximation methods. We investigate a series of algorithmic components to see which, if any, of these components can be packaged into a general purpose algorithm for problems often encountered when fitting psychological models to data by testing them on two popular models from psychology. Although we cannot endorse VB methods in their current form as a complete replacement for conventional methods, we argue that their accuracy and speed warrant inclusion within the cognitive scientist's toolkit.
引用
收藏
页码:535 / 559
页数:25
相关论文
共 50 条
  • [31] Variational Bayesian filtering
    Smidl, Vaclav
    Quinn, Anthony
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (10) : 5020 - 5030
  • [32] Bayesian independent component analysis: Variational methods and non-negative decompositions
    Winther, Ole
    Petersen, Kaare Brandt
    DIGITAL SIGNAL PROCESSING, 2007, 17 (05) : 858 - 872
  • [33] Variational methods for fitting complex Bayesian mixed effects models to health data
    Lee, Cathy Yuen Yi
    Wand, Matt P.
    STATISTICS IN MEDICINE, 2016, 35 (02) : 165 - 188
  • [34] Bayesian Numerical Methods as a Case Study for Statistical Data Science
    Briol, Francois-Xavier
    Girolami, Mark
    STATISTICAL DATA SCIENCE, 2018, : 99 - 110
  • [35] Bayesian reverse-engineering considered as a research strategy for cognitive science
    Zednik, Carlos
    Jaekel, Frank
    SYNTHESE, 2016, 193 (12) : 3951 - 3985
  • [36] Reductio ad bacterium: the ubiquity of Bayesian "brains" and the goals of cognitive science
    Sheredos, Ben
    FRONTIERS IN PSYCHOLOGY, 2012, 3
  • [37] Bayesian reverse-engineering considered as a research strategy for cognitive science
    Carlos Zednik
    Frank Jäkel
    Synthese, 2016, 193 : 3951 - 3985
  • [38] Does philosophy offer cognitive science distinctive methods?
    Brook, A
    PROCEEDINGS OF THE TWENTY FIRST ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, 1999, : 102 - 107
  • [39] Embodied cognitive science: Concepts, methods and implications for psychology
    Tschacher, W
    Scheier, C
    INTEGRATIVE SYSTEMS APPROACHES TO NATURAL AND SOCIAL DYNAMICS, 2001, : 551 - 567
  • [40] Cognitive data science methods and models for engineering applications
    Sangaiah, Arun Kumar
    Hoang Pham
    Chen, Mu-Yen
    Lu, Huimin
    Mercaldo, Francesco
    SOFT COMPUTING, 2019, 23 (19) : 9045 - 9048