Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors

被引:86
|
作者
Wimmer, G. Elliott [1 ,3 ]
Braun, Erin Kendall [1 ]
Daw, Nathaniel D. [4 ,5 ]
Shohamy, Daphna [1 ,2 ]
机构
[1] Columbia Univ, Dept Psychol, New York, NY 10027 USA
[2] Columbia Univ, Kavli Inst Brain Sci, New York, NY 10027 USA
[3] Univ Med Ctr Hamburg Eppendorf, Dept Syst Neurosci, D-20246 Hamburg, Germany
[4] NYU, Ctr Neural Sci, New York, NY 10003 USA
[5] NYU, Dept Psychol, New York, NY 10003 USA
来源
JOURNAL OF NEUROSCIENCE | 2014年 / 34卷 / 45期
基金
美国国家科学基金会;
关键词
decision making; hippocampus; learning; memory; reward; striatum; BRAIN ACTIVITY; HIPPOCAMPUS; MODEL; SIGNALS; SYSTEMS; FMRI; REPRESENTATION; VISUALIZATION; NEUROBIOLOGY; INFORMATION;
D O I
10.1523/JNEUROSCI.0204-14.2014
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental reward-based learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning as much money as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making.
引用
收藏
页码:14901 / 14912
页数:12
相关论文
共 50 条
  • [31] Inferring reward prediction errors in patients with schizophrenia: a dynamic reward task for reinforcement learning
    Li, Chia-Tzu
    Lai, Wen-Sung
    Liu, Chih-Min
    Hsu, Yung-Fong
    FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [32] Spatial-temporal episodic memory modeling for ADLs: encoding, retrieval, and prediction
    Xinjing Song
    Di Wang
    Chai Quek
    Ah-Hwee Tan
    Yanjiang Wang
    Complex & Intelligent Systems, 2024, 10 : 2733 - 2750
  • [33] Spatial-temporal episodic memory modeling for ADLs: encoding, retrieval, and prediction
    Song, Xinjing
    Wang, Di
    Quek, Chai
    Tan, Ah-Hwee
    Wang, Yanjiang
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (02) : 2733 - 2750
  • [34] Neural Correlates of Learning from Induced Insight: A Case for Reward-Based Episodic Encoding
    Kizilirmak, Jasmin M.
    Thuerich, Hannes
    Folta-Schoofs, Kristian
    Schott, Bjoern H.
    Richardson-Klavehn, Alan
    FRONTIERS IN PSYCHOLOGY, 2016, 7
  • [35] Posttraumatic Stress Disorder (PTSD) is Associated With Abnormal Amygdala and Striatal Signaling of Temporal Prediction Errors During a Passive Reward Learning Task
    Fonzo, Gregory
    Enten, Lauren
    DeMarco, Annamarie
    Kline, Rachel
    Nemeroff, Charles
    BIOLOGICAL PSYCHIATRY, 2024, 95 (10) : S92 - S93
  • [36] Posttraumatic Stress Disorder (PTSD) is Associated With Abnormal Amygdala and Striatal Signaling of Temporal Prediction Errors During a Passive Reward Learning Task
    Fonzo, Gregory
    Enten, Lauren
    DeMarco, Annamarie
    Kline, Rachel
    Nemeroff, Charles
    NEUROPSYCHOPHARMACOLOGY, 2023, 48 : 89 - 90
  • [37] Reward prediction errors, not sensory prediction errors, play a major role in model selection in human reinforcement learning
    Wu, Yihao
    Morita, Masahiko
    Izawa, Jun
    NEURAL NETWORKS, 2022, 154 : 109 - 121
  • [38] Principal components analysis of reward prediction errors in a reinforcement learning task
    Sambrook, Thomas D.
    Goslin, Jeremy
    NEUROIMAGE, 2016, 124 : 276 - 286
  • [39] Reward prediction increases striatal dopamine but decreases acetylcholine levels during sucrose self-administration
    Chen, R.
    Huang, Z.
    Ganglia, H.
    Wang, J.
    ALCOHOL-CLINICAL AND EXPERIMENTAL RESEARCH, 2023, 47 : 595 - 595
  • [40] Learning from Sensory and Reward Prediction Errors during Motor Adaptation
    Izawa, Jun
    Shadmehr, Reza
    PLOS COMPUTATIONAL BIOLOGY, 2011, 7 (03)