Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning

被引:167
|
作者
Chase, Henry W. [1 ]
Swainson, Rachel [2 ]
Durham, Lucy [1 ]
Benham, Laura [1 ]
Cools, Roshan [1 ,3 ]
机构
[1] Univ Cambridge, Cambridge CB2 1TN, England
[2] Univ Aberdeen, Aberdeen AB9 1FX, Scotland
[3] Radboud Univ Nijmegen, Nijmegen, Netherlands
基金
英国医学研究理事会; 英国惠康基金;
关键词
ANTERIOR CINGULATE CORTEX; MEDIAL FRONTAL-CORTEX; DECISION-MAKING; PARKINSONS-DISEASE; PREFRONTAL CORTEX; COGNITIVE CONTROL; DOPAMINERGIC MEDICATION; REWARD PREDICTION; HUMAN BRAIN; CONFLICT;
D O I
10.1162/jocn.2010.21456
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We assessed electrophysiological activity over the medial frontal cortex (MFC) during outcome-based behavioral adjustment using a probabilistic reversal learning task. During recording, participants were presented two abstract visual patterns on each trial and had to select the stimulus rewarded on 80% of trials and to avoid the stimulus rewarded on 20% of trials. These contingencies were reversed frequently during the experiment. Previous EEG work has revealed feedback-locked electrophysiological responses over the MFC (feedback-related negativity; FRN), which correlate with the negative prediction error [Holroyd, C. B., & Coles, M. G. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002] and which predict outcome-based adjustment of decision values [Cohen, M. X., & Ranganath, C. Reinforcement learning signals predict future decisions. Journal of Neuroscience, 27, 371-378, 2007]. Unlike previous paradigms, our paradigm enabled us to disentangle, on the one hand, mechanisms related to the reward prediction error, derived from reinforcement learning (RL) modeling, and on the other hand, mechanisms related to explicit rule-based adjustment of actual behavior. Our results demonstrate greater FRN amplitudes with greater RL model-derived prediction errors. Conversely expected negative outcomes that preceded rule-based behavioral reversal were not accompanied by an FRN. This pattern contrasted remarkably with that of the P3 amplitude, which was significantly greater for expected negative outcomes that preceded rule-based behavioral reversal than for unexpected negative outcomes that did not precede behavioral reversal. These data suggest that the FRN reflects prediction error and associated RL-based adjustment of decision values, whereas the P3 reflects adjustment of behavior on the basis of explicit rules.
引用
收藏
页码:936 / 946
页数:11
相关论文
共 50 条
  • [21] Changes of Attention during Value-Based Reversal Learning Are Tracked by N2pc and Feedback-Related Negativity
    Oemisch, Mariann
    Watson, Marcus R.
    Womelsdorf, Thilo
    Schuboe, Anna
    FRONTIERS IN HUMAN NEUROSCIENCE, 2017, 11
  • [22] Learning-related changes in reward expectancy are reflected in the feedback-related negativity
    Bellebaum, Christian
    Daum, Irene
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2008, 27 (07) : 1823 - 1835
  • [23] FEEDBACK RELATED NEGATIVITY: REWARD PREDICTION ERROR OR SALIENCE PREDICTION ERROR?
    Heydari, Sepideh
    Holroyd, Clay B.
    PSYCHOPHYSIOLOGY, 2015, 52 : S111 - S111
  • [24] The Importance of Failure: Feedback-Related Negativity Predicts Motor Learning Efficiency
    van der Helden, Jurjen
    Boksem, Maarten A. S.
    Blom, Jarian H. G.
    CEREBRAL CORTEX, 2010, 20 (07) : 1596 - 1603
  • [25] The Feedback-related Negativity Codes Components of Abstract Inference during Reward-based Decision-making
    Reiter, Andrea M. F.
    Koch, Stefan P.
    Schroeger, Erich
    Hinrichs, Hermann
    Heinze, Hans-Jochen
    Deserno, Lorenz
    Schlagenhauf, Florian
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2016, 28 (08) : 1127 - 1138
  • [26] FEEDBACK-RELATED NEGATIVITY DURING A SOCIAL DECISION-MAKING GAME
    Stanley, Emily M.
    Kuhlman, D. Michael
    Michalak, Jakub
    Simons, Robert F.
    PSYCHOPHYSIOLOGY, 2011, 48 : S76 - S76
  • [27] FEEDBACK-RELATED NEGATIVITY IN RESPONSE TO EXPLOITATION DURING A REPEATED INVESTMENT GAME
    Valadez, Emilio A.
    Jing, Yiming
    Simons, Robert F.
    PSYCHOPHYSIOLOGY, 2014, 51 : S26 - S26
  • [28] The neural consequences of flip-flopping: The feedback-related negativity and salience of reward prediction
    Moser, Jason S.
    Simons, Robert F.
    PSYCHOPHYSIOLOGY, 2009, 46 (02) : 313 - 320
  • [29] Error feedback negativity during a learning task in schizophrenia
    Morris, SE
    Heerey, EA
    Robinson, BM
    Gold, JM
    NEUROPSYCHOPHARMACOLOGY, 2005, 30 : S204 - S204
  • [30] Behavioral approach and reward processing: Results on feedback-related negativity and P3 component
    Lange, Sebastian
    Leue, Anja
    Beauducel, Andre
    BIOLOGICAL PSYCHOLOGY, 2012, 89 (02) : 416 - 425