Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning

被引:167
|
作者
Chase, Henry W. [1 ]
Swainson, Rachel [2 ]
Durham, Lucy [1 ]
Benham, Laura [1 ]
Cools, Roshan [1 ,3 ]
机构
[1] Univ Cambridge, Cambridge CB2 1TN, England
[2] Univ Aberdeen, Aberdeen AB9 1FX, Scotland
[3] Radboud Univ Nijmegen, Nijmegen, Netherlands
基金
英国医学研究理事会; 英国惠康基金;
关键词
ANTERIOR CINGULATE CORTEX; MEDIAL FRONTAL-CORTEX; DECISION-MAKING; PARKINSONS-DISEASE; PREFRONTAL CORTEX; COGNITIVE CONTROL; DOPAMINERGIC MEDICATION; REWARD PREDICTION; HUMAN BRAIN; CONFLICT;
D O I
10.1162/jocn.2010.21456
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We assessed electrophysiological activity over the medial frontal cortex (MFC) during outcome-based behavioral adjustment using a probabilistic reversal learning task. During recording, participants were presented two abstract visual patterns on each trial and had to select the stimulus rewarded on 80% of trials and to avoid the stimulus rewarded on 20% of trials. These contingencies were reversed frequently during the experiment. Previous EEG work has revealed feedback-locked electrophysiological responses over the MFC (feedback-related negativity; FRN), which correlate with the negative prediction error [Holroyd, C. B., & Coles, M. G. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002] and which predict outcome-based adjustment of decision values [Cohen, M. X., & Ranganath, C. Reinforcement learning signals predict future decisions. Journal of Neuroscience, 27, 371-378, 2007]. Unlike previous paradigms, our paradigm enabled us to disentangle, on the one hand, mechanisms related to the reward prediction error, derived from reinforcement learning (RL) modeling, and on the other hand, mechanisms related to explicit rule-based adjustment of actual behavior. Our results demonstrate greater FRN amplitudes with greater RL model-derived prediction errors. Conversely expected negative outcomes that preceded rule-based behavioral reversal were not accompanied by an FRN. This pattern contrasted remarkably with that of the P3 amplitude, which was significantly greater for expected negative outcomes that preceded rule-based behavioral reversal than for unexpected negative outcomes that did not precede behavioral reversal. These data suggest that the FRN reflects prediction error and associated RL-based adjustment of decision values, whereas the P3 reflects adjustment of behavior on the basis of explicit rules.
引用
收藏
页码:936 / 946
页数:11
相关论文
共 50 条
  • [1] Feedback-related negativity codes outcome valence, but not outcome expectancy, during reversal learning
    A. K. L. von Borries
    R. J. Verkes
    B. H. Bulten
    R. Cools
    E. R. A. de Bruijn
    Cognitive, Affective, & Behavioral Neuroscience, 2013, 13 : 737 - 746
  • [2] Feedback-related negativity codes outcome valence, but not outcome expectancy, during reversal learning
    von Borries, A. K. L.
    Verkes, R. J.
    Bulten, B. H.
    Cools, R.
    de Bruijn, E. R. A.
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2013, 13 (04) : 737 - 746
  • [3] The feedback-related negativity indexes prediction error in active but not observational learning
    Burnside, Rebecca
    Fischer, Adrian G.
    Ullsperger, Markus
    PSYCHOPHYSIOLOGY, 2019, 56 (09)
  • [4] ERROR-RELATED NEGATIVITY AND FEEDBACK-RELATED NEGATIVITY ON A REINFORCEMENT LEARNING TASK
    Ridley, Elizabeth
    Jones, Marissa
    Ashworth, Ethan
    Sellers, Eric
    PSYCHOPHYSIOLOGY, 2019, 56 : S58 - S58
  • [5] Expectancy affects the feedback-related negativity (FRN) for delayed feedback in probabilistic learning
    Weismueller, Benjamin
    Bellebaum, Christian
    PSYCHOPHYSIOLOGY, 2016, 53 (11) : 1739 - 1750
  • [6] Changes in the feedback-related negativity with learning
    Sailer, U.
    Fischmeister, F. Ph. S.
    Bauer, H.
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2008, 69 (03) : 217 - 217
  • [7] Modulation of feedback-related negativity during trial-and-error exploration and encoding of behavioral shifts
    Sallet, Jerome
    Camille, Nathalie
    Procyk, Emmanuel
    FRONTIERS IN NEUROSCIENCE, 2013, 7
  • [8] Feedback-related negativity is enhanced in adolescence during a gambling task with and without probabilistic reinforcement learning
    Martinez-Velazquez, Eduardo S.
    Ramos-Loyo, Julieta
    Gonalez-Garrido, Andres A.
    Sequeira, Henrique
    NEUROREPORT, 2015, 26 (02) : 45 - 49
  • [9] Neural response to action and reward prediction errors: Comparing the error-related negativity to behavioral errors and the feedback-related negativity to reward prediction violations
    Potts, Geoffrey F.
    Martin, Laura E.
    Kamp, Siri-Maria
    Donchin, Emanuel
    PSYCHOPHYSIOLOGY, 2011, 48 (02) : 218 - 228
  • [10] Individual differences in reward-prediction-error: extraversion and feedback-related negativity
    Smillie, Luke D.
    Cooper, Andrew J.
    Pickering, Alan D.
    SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2011, 6 (05) : 646 - 652