Dopamine, Locus of Control, and the Exploration-Exploitation Tradeoff

被引:51
|
作者
Kayser, Andrew S. [1 ,2 ,3 ]
Mitchell, Jennifer M. [1 ,2 ]
Weinstein, Dawn [1 ,2 ]
Frank, Michael J. [4 ]
机构
[1] Univ Calif San Francisco, Dept Neurol, San Francisco, CA USA
[2] Ernest Gallo Clin & Res Ctr, Emeryville, CA USA
[3] VA Northern Calif Hlth Care Syst, Dept Neurol, Martinez, CA USA
[4] Brown Univ, Dept Cognit Linguist & Psychol Sci, Providence, RI 02912 USA
基金
美国国家科学基金会;
关键词
INDIVIDUAL-DIFFERENCES; PREFRONTAL CORTEX; REINFORCEMENT; COMT; UNCERTAINTY; DISORDERS; COGNITION; BEHAVIOR; CHOICE;
D O I
10.1038/npp.2014.193
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Whether to continue to exploit a source of reward, or to search for a new one of potentially greater value, is a fundamental and underconstrained decision. Recent computational studies of this exploration-exploitation tradeoff have found that variability in exploration across individuals is influenced by a functional polymorphism (Val158Met) in the catechol-O-methyltransferase (COMT) gene, whose protein product degrades synaptically released dopamine. However, these and other genotype-phenotype associations have rarely been causally tested. To directly test this association and to evaluate additional behavioral characteristics, including perceived locus of control (LOC), here we used the COMT inhibitor tolcapone in a randomized, double-blind, counterbalanced, within-subject study of 66 subjects genotyped for the Val158Met allele to assess the hypothesis that reducing COMT enzymatic activity interacts with genotype to increase uncertainty-driven exploration. In keeping with our initial hypothesis, tolcapone led to an increase in exploratory, but not exploitative, behavior in Met/Met rather than Val/Val subjects. Independent of genotype, those subjects with a more external LOC also showed increases in uncertainty-driven exploration on tolcapone relative to placebo. However, we did not replicate our previous finding that Met/Met subjects show greater exploration at baseline. Together these findings support a model in which exploration is hypothesized to have a dopaminergic basis. Moreover, in keeping with findings in other behavioral and cognitive domains, the response to an increase in presumptively frontal dopamine is dependent upon baseline dopamine tone.
引用
收藏
页码:454 / 462
页数:9
相关论文
共 50 条
  • [21] Speed-vs-Accuracy Tradeoff in Collective Estimation: An Adaptive Exploration-Exploitation Case
    Raoufi, Mohsen
    Hamann, Heiko
    Romanczuk, Pawel
    2021 INTERNATIONAL SYMPOSIUM ON MULTI-ROBOT AND MULTI-AGENT SYSTEMS (MRS), 2021, : 47 - 55
  • [22] Exploration-Exploitation Tradeoff in the Adaptive Information Sampling of Unknown Spatial Fields with Mobile Robots
    Munir, Aiman
    Parasuraman, Ramviyas
    SENSORS, 2023, 23 (23)
  • [23] Exploration-Exploitation in MDPs with Options
    Fruit, Ronan
    Lazaric, Alessandro
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 54, 2017, 54 : 576 - 584
  • [24] The exploration-exploitation dilemma in pain
    Krypotos, Angelos
    PSYCHOSOMATIC MEDICINE, 2020, 82 (06): : A166 - A166
  • [25] Explaining Exploration-Exploitation in Humans
    Candelieri, Antonio
    Ponti, Andrea
    Archetti, Francesco
    BIG DATA AND COGNITIVE COMPUTING, 2022, 6 (04)
  • [26] Adaptive optimal monthly peak building demand limiting strategy based on exploration-exploitation tradeoff
    Xu, Lei
    Tang, Hong
    Wang, Shengwei
    AUTOMATION IN CONSTRUCTION, 2020, 119 (119)
  • [27] The Exploration-Exploitation Dilemma: A Multidisciplinary Framework
    Berger-Tal, Oded
    Nathan, Jonathan
    Meron, Ehud
    Saltz, David
    PLOS ONE, 2014, 9 (04):
  • [28] SPACE - EXPLORATION-EXPLOITATION AND THE ROLE OF MAN
    LOFTUS, JP
    AVIATION SPACE AND ENVIRONMENTAL MEDICINE, 1986, 57 (10): : A69 - A77
  • [29] The two facets of the exploration-exploitation dilemma
    Zhang, Kaifu
    Pan, Wei
    2006 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON INTELLIGENT AGENT TECHNOLOGY, PROCEEDINGS, 2006, : 371 - +
  • [30] Exploration-Exploitation Duality with Both Tradeoff and Synergy: The Curvilinear Interaction Effects of Learning Modes on Innovation Types
    Li, Peter Ping
    Liu, Heng
    Li, Yuan
    Wang, Haifeng
    MANAGEMENT AND ORGANIZATION REVIEW, 2023, 19 (03) : 498 - 532