Asymmetric coding of reward prediction errors in human insula and dorsomedial prefrontal cortex

被引:5
|
作者
Hoy, Colin W. [1 ,2 ]
Quiroga-Martinez, David R. [2 ,3 ,4 ]
Sandoval, Eduardo [2 ]
King-Stephens, David [5 ,6 ]
Laxer, Kenneth D. [5 ]
Weber, Peter [5 ]
Lin, Jack J. [7 ,8 ]
Knight, Robert T. [2 ,9 ]
机构
[1] Univ Calif San Francisco, Dept Neurol, San Francisco, CA 94143 USA
[2] Univ Calif Berkeley, Helen Wills Neurosci Inst, Berkeley, CA 94720 USA
[3] Aarhus Univ, Ctr Mus Brain, Aarhus, Denmark
[4] Royal Acad Mus, Aarhus, Denmark
[5] Calif Pacific Med Ctr, Dept Neurol & Neurosurg, San Francisco, CA USA
[6] Yale Sch Med, Dept Neurol, New Haven, CT USA
[7] Univ Calif Davis, Dept Neurol, Davis, CA USA
[8] Univ Calif Davis, Ctr Mind & Brain, Davis, CA USA
[9] Univ Calif Berkeley, Dept Psychol, Berkeley, CA USA
基金
美国国家科学基金会;
关键词
ANTERIOR CINGULATE CORTEX; ORBITOFRONTAL CORTEX; DIRECT RECORDINGS; TASK CONTROL; DORSAL; DOPAMINE; VALUATION; BRAIN; PAIN; RESPONSES;
D O I
10.1038/s41467-023-44248-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The signed value and unsigned salience of reward prediction errors (RPEs) are critical to understanding reinforcement learning (RL) and cognitive control. Dorsomedial prefrontal cortex (dMPFC) and insula (INS) are key regions for integrating reward and surprise information, but conflicting evidence for both signed and unsigned activity has led to multiple proposals for the nature of RPE representations in these brain areas. Recently developed RL models allow neurons to respond differently to positive and negative RPEs. Here, we use intracranially recorded high frequency activity (HFA) to test whether this flexible asymmetric coding strategy captures RPE coding diversity in human INS and dMPFC. At the region level, we found a bias towards positive RPEs in both areas which paralleled behavioral adaptation. At the local level, we found spatially interleaved neural populations responding to unsigned RPE salience and valence-specific positive and negative RPEs. Furthermore, directional connectivity estimates revealed a leading role of INS in communicating positive and unsigned RPEs to dMPFC. These findings support asymmetric coding across distinct but intermingled neural populations as a core principle of RPE processing and inform theories of the role of dMPFC and INS in RL and cognitive control. It is unclear how dorsomedial prefrontal cortex and insula represent reward prediction errors. Here, the authors analyze human intracranial data to reveal spatially mixed, asymmetric coding of valence-specific and unsigned reward prediction errors, with insula leading dorsomedial prefrontal cortex.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Neural coding of tactile decisions in the human prefrontal cortex
    Pleger, Burkhard
    Ruff, Christian C.
    Blankenburg, Felix
    Bestmann, Sven
    Wiech, Katja
    Stephan, Klaas E.
    Capilla, Almudena
    Friston, Karl J.
    Dolan, Raymond J.
    JOURNAL OF NEUROSCIENCE, 2006, 26 (48): : 12596 - 12601
  • [32] Effects of Amygdala Lesions on Reward-Value Coding in Orbital and Medial Prefrontal Cortex
    Rudebeck, Peter H.
    Mitz, Andrew R.
    Chacko, Ravi V.
    Murray, Elisabeth A.
    NEURON, 2013, 80 (06) : 1519 - 1531
  • [33] Distributed representations of temporally accumulated reward prediction errors in the mouse cortex
    Makino, Hiroshi
    Suhaimi, Ahmad
    SCIENCE ADVANCES, 2025, 11 (04):
  • [34] Non-invasive stimulation reveals ventromedial prefrontal cortex function in reward prediction and reward processing
    Rehbein, Maimu Alissa
    Kroker, Thomas
    Winker, Constantin
    Ziehfreund, Lena
    Reschke, Anna
    Boelte, Jens
    Wyczesany, Miroslaw
    Roesmann, Kati
    Wessing, Ida
    Junghoefer, Markus
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [35] ROLE OF PRELIMBIC MEDIAL PREFRONTAL CORTEX NEURONS IN REWARD PREDICTION ERROR SIGNALING
    Hou, S.
    Glover, E. J.
    ALCOHOLISM-CLINICAL AND EXPERIMENTAL RESEARCH, 2022, 46 : 81A - 81A
  • [36] Human insula activation reflects risk prediction errors as well as risk
    Preuschoff, Kerstin
    Quartz, Steven R.
    Bossaerts, Peter
    JOURNAL OF NEUROSCIENCE, 2008, 28 (11): : 2745 - 2752
  • [37] Contributions of the amygdala to reward expectancy and choice signals in human prefrontal cortex
    Hampton, Alan N.
    Adolphs, Ralph
    Tyszka, Michael J.
    O'Doherty, John P.
    NEURON, 2007, 55 (04) : 545 - 555
  • [38] Risk-dependent reward value signal in human prefrontal cortex
    Tobler, Philippe N.
    Christopoulos, George I.
    O'Doherty, John P.
    Dolan, Raymond J.
    Schultz, Wolfram
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2009, 106 (17) : 7185 - 7190
  • [39] Widespread temporal coding of cognitive control in the human prefrontal cortex
    Elliot H. Smith
    Guillermo Horga
    Mark J. Yates
    Charles B. Mikell
    Garrett P. Banks
    Yagna J. Pathak
    Catherine A. Schevon
    Guy M. McKhann
    Benjamin Y. Hayden
    Matthew M. Botvinick
    Sameer A. Sheth
    Nature Neuroscience, 2019, 22 : 1883 - 1891
  • [40] Widespread temporal coding of cognitive control in the human prefrontal cortex
    Smith, Elliot H.
    Horga, Guillermo
    Yates, Mark J.
    Mikell, Charles B.
    Banks, Garrett P.
    Pathak, Yagna J.
    Schevon, Catherine A.
    McKhann, Guy M., II
    Hayden, Benjamin Y.
    Botvinick, Matthew M.
    Sheth, Sameer A.
    NATURE NEUROSCIENCE, 2019, 22 (11) : 1883 - +