Reinforcement-conflict based control: An integrative model of error detection in anterior cingulate cortex

被引:5
|
作者
Zendehrouh, Sareh [1 ]
Gharibzadeh, Shahriar [1 ]
Towhidkhah, Farzad [1 ]
机构
[1] Amirkabir Univ Technol, Dept Biomed Engn, Tehran, Iran
关键词
Error related negativity; N200; Performance monitoring; Executive control; Computational model; REACTION-TIME TASKS; PREFRONTAL CORTEX; COGNITIVE CONTROL; PREDICTION ERROR; NEURAL SYSTEM; BASAL GANGLIA; GO/NO-GO; DOPAMINE; ERP; LIKELIHOOD;
D O I
10.1016/j.neucom.2013.06.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The concepts of error detection and compensation play a key role in the studies of human brain behavior. In particular, studies of event-related brain potentials have discovered the presence of a component following errors named the error related negativity (ERN). According to the highly used theories of this field, the ERN can occur due to an error detection in reward prediction (the reinforcement learning theory) or conflict detection (the conflict monitoring theory). Since each of these theories has given numerous experimental validations, there is an urge to reconcile them. Although there have been efforts to integrate these two theories, the research in this field needs to be improved. The present study aims at integrating the above-mentioned theories by proposing a model that simulates the role of anterior cingulate cortex in performance monitoring and reinforcement-guided action selection. In this model, an executive control module uses the conflict signal and the reward prediction error to adjust the timing of the control and to regulate the strength of the control over other structures. The simulation results show that the proposed model can successfully produce the expected experimental results in a modified version of the Eriksen flanker task. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 149
页数:10
相关论文
共 50 条
  • [1] Dissociation between conflict detection and error monitoring in the human anterior cingulate cortex
    Swick, D
    Turken, U
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (25) : 16354 - 16359
  • [2] Dissociating Response Conflict and Error Likelihood in Anterior Cingulate Cortex
    Yeung, Nick
    Nieuwenhuis, Sander
    JOURNAL OF NEUROSCIENCE, 2009, 29 (46): : 14506 - 14510
  • [3] Anterior cingulate cortex and conflict detection: An update of theory and data
    Cameron S. Carter
    Vincent van Veen
    Cognitive, Affective, & Behavioral Neuroscience, 2007, 7 : 367 - 379
  • [4] Anterior cingulate cortex and conflict detection: An update of theory and data
    Carter, Cameron S.
    van Veen, Vincent
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2007, 7 (04) : 367 - 379
  • [5] Anterior cingulate cortex, error detection, and the online monitoring of performance
    Carter, Cameron S.
    Braver, Todd S.
    Barch, Deanna M.
    Botvinick, Matthew M.
    Noll, Douglas
    Cohen, Jonathan D.
    1998, (280)
  • [6] Anterior cingulate cortex, error detection, and the online monitoring of performance
    Carter, CS
    Braver, TS
    Barch, DM
    Botvinick, MM
    Noll, D
    Cohen, JD
    SCIENCE, 1998, 280 (5364) : 747 - 749
  • [7] The anterior cingulate cortex in error detection and conflict monitoring. Unitary neuronal activity in monkeys.
    Bioulac, B
    Michelet, T
    Guehl, D
    Aouizerate, B
    Burbaud, P
    BULLETIN DE L ACADEMIE NATIONALE DE MEDECINE, 2005, 189 (07): : 1529 - 1540
  • [8] Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood
    Aarts, Esther
    Roelofs, Ardi
    Van Turennout, Miranda
    JOURNAL OF NEUROSCIENCE, 2008, 28 (18): : 4671 - 4678
  • [9] The Expected Value of Control: An Integrative Theory of Anterior Cingulate Cortex Function
    Shenhav, Amitai
    Botvinick, Matthew M.
    Cohen, Jonathan D.
    NEURON, 2013, 79 (02) : 217 - 240
  • [10] Error negativity does not reflect conflict: A reappraisal of conflict monitoring and anterior cingulate cortex activity
    Burle, Boris
    Roger, Clemence
    Allain, Sonia
    Vidal, Franck
    Hasbroucq, Thierry
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2008, 20 (09) : 1637 - 1655