Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors

被引:86
|
作者
Wimmer, G. Elliott [1 ,3 ]
Braun, Erin Kendall [1 ]
Daw, Nathaniel D. [4 ,5 ]
Shohamy, Daphna [1 ,2 ]
机构
[1] Columbia Univ, Dept Psychol, New York, NY 10027 USA
[2] Columbia Univ, Kavli Inst Brain Sci, New York, NY 10027 USA
[3] Univ Med Ctr Hamburg Eppendorf, Dept Syst Neurosci, D-20246 Hamburg, Germany
[4] NYU, Ctr Neural Sci, New York, NY 10003 USA
[5] NYU, Dept Psychol, New York, NY 10003 USA
来源
JOURNAL OF NEUROSCIENCE | 2014年 / 34卷 / 45期
基金
美国国家科学基金会;
关键词
decision making; hippocampus; learning; memory; reward; striatum; BRAIN ACTIVITY; HIPPOCAMPUS; MODEL; SIGNALS; SYSTEMS; FMRI; REPRESENTATION; VISUALIZATION; NEUROBIOLOGY; INFORMATION;
D O I
10.1523/JNEUROSCI.0204-14.2014
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental reward-based learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning as much money as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making.
引用
收藏
页码:14901 / 14912
页数:12
相关论文
共 50 条
  • [11] Working Memory Load Strengthens Reward Prediction Errors
    Collins, Anne G. E.
    Ciullo, Brittany
    Frank, Michael J.
    Badre, David
    JOURNAL OF NEUROSCIENCE, 2017, 37 (16): : 4332 - 4342
  • [12] Reward prediction errors create event boundaries in memory
    Rouhani, Nina
    Norman, Kenneth A.
    Niv, Yael
    Bornstein, Aaron M.
    COGNITION, 2020, 203
  • [13] Impaired reward prediction error encoding and striatal-midbrain connectivity in depression
    Kumar, Poornima
    Goer, Franziska
    Murray, Laura
    Dillon, Daniel G.
    Beltzer, Miranda L.
    Cohen, Andrew L.
    Brooks, Nancy H.
    Pizzagalli, Diego A.
    NEUROPSYCHOPHARMACOLOGY, 2018, 43 (07) : 1581 - 1588
  • [14] Impaired reward prediction error encoding and striatal-midbrain connectivity in depression
    Poornima Kumar
    Franziska Goer
    Laura Murray
    Daniel G. Dillon
    Miranda L. Beltzer
    Andrew L. Cohen
    Nancy H. Brooks
    Diego A. Pizzagalli
    Neuropsychopharmacology, 2018, 43 : 1581 - 1588
  • [15] Striatal interneurons and reward prediction errors (Commentary on Apicella et al.)
    Berke, Joshua D.
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2009, 30 (03) : 514 - 514
  • [16] Reduced Striatal Responses to Reward Prediction Errors in Older Compared with Younger Adults
    Eppinger, Ben
    Schuck, Nicolas W.
    Nystrom, Leigh E.
    Cohen, Jonathan D.
    JOURNAL OF NEUROSCIENCE, 2013, 33 (24): : 9905 - 9912
  • [17] Selective encoding of reward predictions and prediction errors by globus pallidus subpopulations
    Farries, Michael A.
    Faust, Thomas W.
    Mohebi, Ali
    Berke, Joshua D.
    CURRENT BIOLOGY, 2023, 33 (19) : 4124 - +
  • [18] Signed reward prediction errors drive declarative learning
    De Loof, Esther
    Ergo, Kate
    Naert, Lien
    Janssens, Clio
    Talsma, Durk
    Van Opstal, Filip
    Verguts, Tom
    PLOS ONE, 2018, 13 (01):
  • [19] Oscillatory signatures of reward prediction errors in declarative learning
    Ergo, Kate
    De Loof, Esther
    Janssens, Clio
    Verguts, Tom
    NEUROIMAGE, 2019, 186 : 137 - 145
  • [20] The effect of reward prediction errors on temporal order and source memory
    Zhang Hongchi
    Cheng Xuan
    Mao Weibin
    ACTA PSYCHOLOGICA SINICA, 2023, 55 (07) : 1049 - 1062