Asymmetric coding of reward prediction errors in human insula and dorsomedial prefrontal cortex

被引:5
|
作者
Hoy, Colin W. [1 ,2 ]
Quiroga-Martinez, David R. [2 ,3 ,4 ]
Sandoval, Eduardo [2 ]
King-Stephens, David [5 ,6 ]
Laxer, Kenneth D. [5 ]
Weber, Peter [5 ]
Lin, Jack J. [7 ,8 ]
Knight, Robert T. [2 ,9 ]
机构
[1] Univ Calif San Francisco, Dept Neurol, San Francisco, CA 94143 USA
[2] Univ Calif Berkeley, Helen Wills Neurosci Inst, Berkeley, CA 94720 USA
[3] Aarhus Univ, Ctr Mus Brain, Aarhus, Denmark
[4] Royal Acad Mus, Aarhus, Denmark
[5] Calif Pacific Med Ctr, Dept Neurol & Neurosurg, San Francisco, CA USA
[6] Yale Sch Med, Dept Neurol, New Haven, CT USA
[7] Univ Calif Davis, Dept Neurol, Davis, CA USA
[8] Univ Calif Davis, Ctr Mind & Brain, Davis, CA USA
[9] Univ Calif Berkeley, Dept Psychol, Berkeley, CA USA
基金
美国国家科学基金会;
关键词
ANTERIOR CINGULATE CORTEX; ORBITOFRONTAL CORTEX; DIRECT RECORDINGS; TASK CONTROL; DORSAL; DOPAMINE; VALUATION; BRAIN; PAIN; RESPONSES;
D O I
10.1038/s41467-023-44248-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The signed value and unsigned salience of reward prediction errors (RPEs) are critical to understanding reinforcement learning (RL) and cognitive control. Dorsomedial prefrontal cortex (dMPFC) and insula (INS) are key regions for integrating reward and surprise information, but conflicting evidence for both signed and unsigned activity has led to multiple proposals for the nature of RPE representations in these brain areas. Recently developed RL models allow neurons to respond differently to positive and negative RPEs. Here, we use intracranially recorded high frequency activity (HFA) to test whether this flexible asymmetric coding strategy captures RPE coding diversity in human INS and dMPFC. At the region level, we found a bias towards positive RPEs in both areas which paralleled behavioral adaptation. At the local level, we found spatially interleaved neural populations responding to unsigned RPE salience and valence-specific positive and negative RPEs. Furthermore, directional connectivity estimates revealed a leading role of INS in communicating positive and unsigned RPEs to dMPFC. These findings support asymmetric coding across distinct but intermingled neural populations as a core principle of RPE processing and inform theories of the role of dMPFC and INS in RL and cognitive control. It is unclear how dorsomedial prefrontal cortex and insula represent reward prediction errors. Here, the authors analyze human intracranial data to reveal spatially mixed, asymmetric coding of valence-specific and unsigned reward prediction errors, with insula leading dorsomedial prefrontal cortex.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Human hippocampus and dorsomedial prefrontal cortex infer and update latent causes during social interaction
    Mahmoodi, Ali
    Luo, Shuyi
    Harbison, Caroline
    Piray, Payam
    Rushworth, Matthew F. S.
    NEURON, 2024, 112 (22)
  • [42] Causal evidence for task-specific involvement of the dorsomedial prefrontal cortex in human social cognition
    Martin, Andrew K.
    Dzafic, Ilvana
    Ramdave, Swathi
    Meinzer, Marcus
    SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2017, 12 (08) : 1209 - 1218
  • [43] SENSITIVITY OF ANTERIOR CINGULATE CORTEX TO REWARD PREDICTION ERRORS AT TWO LEVELS OF HIERARCHY
    Shahnazian, Danesh
    Holroyd, Clay B.
    PSYCHOPHYSIOLOGY, 2015, 52 : S65 - S65
  • [44] Top-down attention to prediction errors of action values in the prefrontal cortex
    Matsumoto, Kenji
    Matsumoto, Madoka
    Abe, Hiroshi
    Tanaka, Keiji
    NEUROSCIENCE RESEARCH, 2007, 58 : S22 - S22
  • [45] Local inactivation of primate prefrontal cortex impairs reward prediction based on category inference
    Fan, Hongwei
    Pan, Xiaochuan
    Sakagami, Masamichi
    NEUROSCIENCE RESEARCH, 2011, 71 : E372 - E372
  • [46] Instructed delay activity in the human prefrontal cortex is modulated by monetary reward expectation
    Ramnani, N
    Miall, RC
    CEREBRAL CORTEX, 2003, 13 (03) : 318 - 327
  • [47] Neural activity in human ventromedial prefrontal cortex reflecting the intention to save reward
    Zangemeister, Leopold
    Grabenhorst, Fabian
    Schultz, Wolfram
    SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2019, 14 (12) : 1255 - 1261
  • [48] Activity in human ventral striatum locked to errors of reward prediction
    Pagnoni, G
    Zink, CF
    Montague, PR
    Berns, GS
    NATURE NEUROSCIENCE, 2002, 5 (02) : 97 - 98
  • [49] Activity in human ventral striatum locked to errors of reward prediction
    Giuseppe Pagnoni
    Caroline F. Zink
    P. Read Montague
    Gregory S. Berns
    Nature Neuroscience, 2002, 5 : 97 - 98
  • [50] BOLD responses to negative reward prediction errors in human habenula
    Salas, Ramiro
    Baldwin, Philip
    de Biasi, Mariella
    Montague, P. Read
    FRONTIERS IN HUMAN NEUROSCIENCE, 2010, 4 : 1 - 7