Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning

被引:167
|
作者
Chase, Henry W. [1 ]
Swainson, Rachel [2 ]
Durham, Lucy [1 ]
Benham, Laura [1 ]
Cools, Roshan [1 ,3 ]
机构
[1] Univ Cambridge, Cambridge CB2 1TN, England
[2] Univ Aberdeen, Aberdeen AB9 1FX, Scotland
[3] Radboud Univ Nijmegen, Nijmegen, Netherlands
基金
英国医学研究理事会; 英国惠康基金;
关键词
ANTERIOR CINGULATE CORTEX; MEDIAL FRONTAL-CORTEX; DECISION-MAKING; PARKINSONS-DISEASE; PREFRONTAL CORTEX; COGNITIVE CONTROL; DOPAMINERGIC MEDICATION; REWARD PREDICTION; HUMAN BRAIN; CONFLICT;
D O I
10.1162/jocn.2010.21456
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We assessed electrophysiological activity over the medial frontal cortex (MFC) during outcome-based behavioral adjustment using a probabilistic reversal learning task. During recording, participants were presented two abstract visual patterns on each trial and had to select the stimulus rewarded on 80% of trials and to avoid the stimulus rewarded on 20% of trials. These contingencies were reversed frequently during the experiment. Previous EEG work has revealed feedback-locked electrophysiological responses over the MFC (feedback-related negativity; FRN), which correlate with the negative prediction error [Holroyd, C. B., & Coles, M. G. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002] and which predict outcome-based adjustment of decision values [Cohen, M. X., & Ranganath, C. Reinforcement learning signals predict future decisions. Journal of Neuroscience, 27, 371-378, 2007]. Unlike previous paradigms, our paradigm enabled us to disentangle, on the one hand, mechanisms related to the reward prediction error, derived from reinforcement learning (RL) modeling, and on the other hand, mechanisms related to explicit rule-based adjustment of actual behavior. Our results demonstrate greater FRN amplitudes with greater RL model-derived prediction errors. Conversely expected negative outcomes that preceded rule-based behavioral reversal were not accompanied by an FRN. This pattern contrasted remarkably with that of the P3 amplitude, which was significantly greater for expected negative outcomes that preceded rule-based behavioral reversal than for unexpected negative outcomes that did not precede behavioral reversal. These data suggest that the FRN reflects prediction error and associated RL-based adjustment of decision values, whereas the P3 reflects adjustment of behavior on the basis of explicit rules.
引用
收藏
页码:936 / 946
页数:11
相关论文
共 50 条
  • [41] Punishment Feedback Impairs Memory and Changes Cortical Feedback-Related Potentials During Motor Learning
    Hill, Christopher M.
    Stringer, Mason
    Waddell, Dwight E.
    Del Arco, Alberto
    FRONTIERS IN HUMAN NEUROSCIENCE, 2020, 14
  • [42] Dynamic changes of brain networks during feedback-related processing of reinforcement learning in schizophrenia
    Zhao, Zongya
    Wang, Chang
    Yuan, Qingli
    Zhao, Junqiang
    Ren, Qiongqiong
    Xu, Yongtao
    Li, Jie
    Yu, Yi
    BRAIN RESEARCH, 2020, 1746
  • [43] The Good, the Bad, or the Useful? The Examination of the Relationship between the Feedback-related Negativity (FRN) and Long-term Learning Outcomes
    Arbel, Yael
    Goforth, Kristen
    Donchin, Emanuel
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2013, 25 (08) : 1249 - 1260
  • [44] Frontal Feedback-Related Potentials in Nonhuman Primates: Modulation during Learning and under Haloperidol
    Vezoli, Julien
    Procyk, Emmanuel
    JOURNAL OF NEUROSCIENCE, 2009, 29 (50): : 15675 - 15683
  • [45] Reward Sensitivity (Behavioral Activation System), Cognitive, and Metacognitive Control in Gambling Behavior: Evidences From Behavioral, Feedback-Related Negativity, and P300 Effect
    Balconi, Michela
    Finocchiaro, Roberta
    Canavesio, Ylenia
    JOURNAL OF NEUROPSYCHIATRY AND CLINICAL NEUROSCIENCES, 2015, 27 (03) : 219 - 227
  • [46] Serotonergic modulation of prefrontal cortex during negative feedback in probabilistic reversal learning
    Evers, EAT
    Cools, R
    Clark, L
    van der Veen, FM
    Jolles, J
    Sahakian, BJ
    Robbins, TW
    NEUROPSYCHOPHARMACOLOGY, 2005, 30 (06) : 1138 - 1147
  • [47] Serotonergic Modulation of Prefrontal Cortex during Negative Feedback in Probabilistic Reversal Learning
    Elizabeth A T Evers
    Roshan Cools
    Luke Clark
    Frederik M van der Veen
    Jelle Jolles
    Barbara J Sahakian
    Trevor W Robbins
    Neuropsychopharmacology, 2005, 30 : 1138 - 1147
  • [48] FEEDBACK NEGATIVITY AND FEEDBACK-RELATED P3 DURING THE MONETARY INCENTIVE DELAY TASK IN INDIVIDUALS AT HIGH AND LOW FAMILY RISK FOR DEPRESSION
    Gao, Yifan
    Panier, Lidia
    Gameroff, Marc
    Auerbach, Randy
    Posner, Jonathan
    Weissman, Myrna
    Kayser, Jurgen
    PSYCHOPHYSIOLOGY, 2022, 59 : S126 - S127
  • [49] Separating stimulus-related and feedback-related activity during categorization learning using event-related fMRI
    Poldrack, R
    Clark, J
    Shohamy, D
    Myers, C
    Gluck, M
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2002, : 33 - 33
  • [50] A SHIFT IN PERSPECTIVES: INVESTIGATING THE IMPACT OF TRUSTOR-TRUSTEE ROLE REVERSALS ON FEEDBACK-RELATED NEGATIVITY DURING OUTCOME EVALUATION IN THE TRUST GAME
    Paelecke, Marko
    Mueller, Saskia
    Rodrigues, Johannes
    Hewig, Johannes
    PSYCHOPHYSIOLOGY, 2024, 61 : S245 - S245