Dopamine, Locus of Control, and the Exploration-Exploitation Tradeoff

被引:51
|
作者
Kayser, Andrew S. [1 ,2 ,3 ]
Mitchell, Jennifer M. [1 ,2 ]
Weinstein, Dawn [1 ,2 ]
Frank, Michael J. [4 ]
机构
[1] Univ Calif San Francisco, Dept Neurol, San Francisco, CA USA
[2] Ernest Gallo Clin & Res Ctr, Emeryville, CA USA
[3] VA Northern Calif Hlth Care Syst, Dept Neurol, Martinez, CA USA
[4] Brown Univ, Dept Cognit Linguist & Psychol Sci, Providence, RI 02912 USA
基金
美国国家科学基金会;
关键词
INDIVIDUAL-DIFFERENCES; PREFRONTAL CORTEX; REINFORCEMENT; COMT; UNCERTAINTY; DISORDERS; COGNITION; BEHAVIOR; CHOICE;
D O I
10.1038/npp.2014.193
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Whether to continue to exploit a source of reward, or to search for a new one of potentially greater value, is a fundamental and underconstrained decision. Recent computational studies of this exploration-exploitation tradeoff have found that variability in exploration across individuals is influenced by a functional polymorphism (Val158Met) in the catechol-O-methyltransferase (COMT) gene, whose protein product degrades synaptically released dopamine. However, these and other genotype-phenotype associations have rarely been causally tested. To directly test this association and to evaluate additional behavioral characteristics, including perceived locus of control (LOC), here we used the COMT inhibitor tolcapone in a randomized, double-blind, counterbalanced, within-subject study of 66 subjects genotyped for the Val158Met allele to assess the hypothesis that reducing COMT enzymatic activity interacts with genotype to increase uncertainty-driven exploration. In keeping with our initial hypothesis, tolcapone led to an increase in exploratory, but not exploitative, behavior in Met/Met rather than Val/Val subjects. Independent of genotype, those subjects with a more external LOC also showed increases in uncertainty-driven exploration on tolcapone relative to placebo. However, we did not replicate our previous finding that Met/Met subjects show greater exploration at baseline. Together these findings support a model in which exploration is hypothesized to have a dopaminergic basis. Moreover, in keeping with findings in other behavioral and cognitive domains, the response to an increase in presumptively frontal dopamine is dependent upon baseline dopamine tone.
引用
收藏
页码:454 / 462
页数:9
相关论文
共 50 条
  • [1] Dopamine, Locus of Control, and the Exploration-Exploitation Tradeoff
    Andrew S Kayser
    Jennifer M Mitchell
    Dawn Weinstein
    Michael J Frank
    Neuropsychopharmacology, 2015, 40 : 454 - 462
  • [2] Dopamine and Norepinephrine Differentially Mediate the Exploration-Exploitation Tradeoff
    Chen, Cathy S.
    Mueller, Dana
    Knep, Evan
    Ebitz, R. Becket
    Grissom, Nicola M.
    JOURNAL OF NEUROSCIENCE, 2024, 44 (44):
  • [3] Social Learning and the Exploration-Exploitation Tradeoff
    Mintz, Brian
    Fu, Feng
    COMPUTATION, 2023, 11 (05)
  • [4] Adaptive exploration policy for exploration-exploitation tradeoff in continuous action control optimization
    Li, Min
    Huang, Tianyi
    Zhu, William
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (12) : 3491 - 3501
  • [5] Adaptive Exploration-Exploitation Tradeoff for Opportunistic Bandits
    Wu, Huasen
    Guo, Xueying
    Liu, Xin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [6] The Exploration-Exploitation Tradeoff and Efficiency in Knowledge Production
    Sudhir, K.
    MARKETING SCIENCE, 2016, 35 (01) : 1 - 9
  • [7] Source Coding in the Presence of Exploration-Exploitation Tradeoff
    Akyol, Emrah
    Mitra, Urbashi
    Tuncel, Ertem
    Rose, Kenneth
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 2057 - 2061
  • [8] Unpacking the exploration-exploitation tradeoff on Snapchat: The relationships between users' exploration-exploitation interests and server log data
    Gomez-Zara, Diego
    Liu, Yozen
    Neves, Leonardo
    Shah, Neil
    Bos, Maarten W.
    COMPUTERS IN HUMAN BEHAVIOR, 2024, 150
  • [9] The Empirical Analysis of Exploration-Exploitation Tradeoff for Uncertain Environment
    Li, Kun
    Li, Ming
    Chen, Hao
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 1, 2014, : 274 - 279
  • [10] Organizational learning with forgetting: Reconsidering the exploration-exploitation tradeoff
    Miller, Kent D.
    Martignoni, Dirk
    STRATEGIC ORGANIZATION, 2016, 14 (01) : 53 - 72