Subgoal- and Goal-related Reward Prediction Errors in Medial Prefrontal Cortex

被引:19
|
作者
Ribas-Fernandes, Jose J. F. [1 ,4 ]
Shahnazian, Danesh [1 ]
Holroyd, Clay B. [1 ]
Botvinick, Matthew M. [2 ,3 ,4 ]
机构
[1] Univ Victoria, Victoria, BC, Canada
[2] DeepMind, London, England
[3] UCL, London, England
[4] Princeton Univ, Dept Psychol, Princeton, NJ 08544 USA
关键词
HIERARCHICAL CONTROL; NEURAL MECHANISMS; BEHAVIOR; SIGNALS;
D O I
10.1162/jocn_a_01341
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
A longstanding view of the organization of human and animal behavior holds that behavior is hierarchically organizedin other words, directed toward achieving superordinate goals through the achievement of subordinate goals or subgoals. However, most research in neuroscience has focused on tasks without hierarchical structure. In past work, we have shown that negative reward prediction error (RPE) signals in medial prefrontal cortex (mPFC) can be linked not only to superordinate goals but also to subgoals. This suggests that mPFC tracks impediments in the progression toward subgoals. Using fMRI of human participants engaged in a hierarchical navigation task, here we found that mPFC also processes positive prediction errors at the level of subgoals, indicating that this brain region is sensitive to advances in subgoal completion. However, when subgoal RPEs were elicited alongside with goal-related RPEs, mPFC responses reflected only the goal-related RPEs. These findings suggest that information from different levels of hierarchy is processed selectively, depending on the task context.
引用
收藏
页码:8 / 23
页数:16
相关论文
共 50 条
  • [41] Effects of Amygdala Lesions on Reward-Value Coding in Orbital and Medial Prefrontal Cortex
    Rudebeck, Peter H.
    Mitz, Andrew R.
    Chacko, Ravi V.
    Murray, Elisabeth A.
    NEURON, 2013, 80 (06) : 1519 - 1531
  • [42] Oscillatory Activity in the Medial Prefrontal Cortex and Nucleus Accumbens Correlates with Impulsivity and Reward Outcome
    Donnelly, Nicholas A.
    Holtzman, Tahl
    Rich, P. Dylan
    Nevado-Holgado, Alejo J.
    Fernando, Anushka B. P.
    Van Dijck, Gert
    Holzhammer, Tobias
    Paul, Oliver
    Ruther, Patrick
    Paulsen, Ole
    Robbins, Trevor W.
    Dalley, Jeffrey W.
    PLOS ONE, 2014, 9 (10):
  • [43] Modulation of PKA activity in the medial prefrontal cortex: Effects on attention, motor activity and reward
    Paine, Tracie A.
    Pohlman, Jessica M.
    Carlezon, William A.
    NEUROPSYCHOPHARMACOLOGY, 2006, 31 : S255 - S255
  • [44] Perceived stress predicts altered reward and loss feedback processing in medial prefrontal cortex
    Treadway, Michael T.
    Buckholtz, Joshua W.
    Zald, David H.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
  • [45] Medial prefrontal cell activity signaling prediction errors of action values
    Madoka Matsumoto
    Kenji Matsumoto
    Hiroshi Abe
    Keiji Tanaka
    Nature Neuroscience, 2007, 10 : 647 - 656
  • [46] Reward prediction based on stimulus categorization in primate lateral prefrontal cortex
    Xiaochuan Pan
    Kosuke Sawa
    Ichiro Tsuda
    Minoru Tsukada
    Masamichi Sakagami
    Nature Neuroscience, 2008, 11 : 703 - 712
  • [47] Working memory and reward increase the accuracy of animal location encoding in the medial prefrontal cortex
    Ma, Xiaoyu
    Zheng, Charles
    Chen, Yenho
    Pereira, Francisco
    Li, Zheng
    CEREBRAL CORTEX, 2023, 33 (05) : 2245 - 2259
  • [48] Reward-Based Learning Drives Rapid Sensory Signals in Medial Prefrontal Cortex and Dorsal Hippocampus Necessary for Goal-Directed Behavior
    Le Merre, Pierre
    Esmaeili, Vahid
    Charriere, Eloise
    Galan, Katia
    Salin, Paul-A.
    Petersen, Carl C. H.
    Crochet, Sylvain
    NEURON, 2018, 97 (01) : 83 - +
  • [49] The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors
    Talmi, Deborah
    Atkinson, Ryan
    El-Deredy, Wael
    JOURNAL OF NEUROSCIENCE, 2013, 33 (19): : 8264 - 8269
  • [50] Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning
    Ostlund, SB
    Balleine, BW
    JOURNAL OF NEUROSCIENCE, 2005, 25 (34): : 7763 - 7770