Dopamine, Locus of Control, and the Exploration-Exploitation Tradeoff

被引:51
|
作者
Kayser, Andrew S. [1 ,2 ,3 ]
Mitchell, Jennifer M. [1 ,2 ]
Weinstein, Dawn [1 ,2 ]
Frank, Michael J. [4 ]
机构
[1] Univ Calif San Francisco, Dept Neurol, San Francisco, CA USA
[2] Ernest Gallo Clin & Res Ctr, Emeryville, CA USA
[3] VA Northern Calif Hlth Care Syst, Dept Neurol, Martinez, CA USA
[4] Brown Univ, Dept Cognit Linguist & Psychol Sci, Providence, RI 02912 USA
基金
美国国家科学基金会;
关键词
INDIVIDUAL-DIFFERENCES; PREFRONTAL CORTEX; REINFORCEMENT; COMT; UNCERTAINTY; DISORDERS; COGNITION; BEHAVIOR; CHOICE;
D O I
10.1038/npp.2014.193
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Whether to continue to exploit a source of reward, or to search for a new one of potentially greater value, is a fundamental and underconstrained decision. Recent computational studies of this exploration-exploitation tradeoff have found that variability in exploration across individuals is influenced by a functional polymorphism (Val158Met) in the catechol-O-methyltransferase (COMT) gene, whose protein product degrades synaptically released dopamine. However, these and other genotype-phenotype associations have rarely been causally tested. To directly test this association and to evaluate additional behavioral characteristics, including perceived locus of control (LOC), here we used the COMT inhibitor tolcapone in a randomized, double-blind, counterbalanced, within-subject study of 66 subjects genotyped for the Val158Met allele to assess the hypothesis that reducing COMT enzymatic activity interacts with genotype to increase uncertainty-driven exploration. In keeping with our initial hypothesis, tolcapone led to an increase in exploratory, but not exploitative, behavior in Met/Met rather than Val/Val subjects. Independent of genotype, those subjects with a more external LOC also showed increases in uncertainty-driven exploration on tolcapone relative to placebo. However, we did not replicate our previous finding that Met/Met subjects show greater exploration at baseline. Together these findings support a model in which exploration is hypothesized to have a dopaminergic basis. Moreover, in keeping with findings in other behavioral and cognitive domains, the response to an increase in presumptively frontal dopamine is dependent upon baseline dopamine tone.
引用
收藏
页码:454 / 462
页数:9
相关论文
共 50 条
  • [41] The exploration-exploitation dilemma in pain: an experimental investigation
    Krypotos, Angelos-Miltiadis
    Crombez, Geert
    Alves, Maryna
    Claes, Nathalie
    Vlaeyen, Johan W. S.
    PAIN, 2022, 163 (02) : E215 - E233
  • [42] Exploration-exploitation: A cognitive dilemma still unresolved
    James, Russell N., III
    COGNITIVE NEUROSCIENCE, 2015, 6 (04) : 219 - 221
  • [43] Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia
    Humphries, Mark D.
    Khamassi, Mehdi
    Gurney, Kevin
    FRONTIERS IN NEUROSCIENCE, 2012, 6
  • [44] Adaptive Exploration-Exploitation Active Learning of Gaussian Processes
    Kontoudis, George P.
    Otte, Michael
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 9448 - 9455
  • [45] An adaptive approach for the exploration-exploitation dilemma for learning agents
    Rejeb, L
    Guessoum, Z
    M'Hallah, R
    MULTI-AGENT SYSTEMS AND APPLICATIONS IV, PROCEEDINGS, 2005, 3690 : 316 - 325
  • [46] Online learning robust MPC: an exploration-exploitation approach
    Manzano, J. M.
    Calliess, J.
    de la Pena, D. Munoz
    Limon, D.
    IFAC PAPERSONLINE, 2020, 53 (02): : 5292 - 5297
  • [47] Particle Swarm Optimization with an Improved Exploration-Exploitation Balance
    Ben Ghalia, Mounir
    2008 51ST MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1 AND 2, 2008, : 759 - 762
  • [48] Uncertainty avoidance and the exploration-exploitation trade-off
    Broekhuizen, Thijs L. J.
    Giarratana, Marco S.
    Torres, Anna
    EUROPEAN JOURNAL OF MARKETING, 2017, 51 (11-12) : 2080 - 2100
  • [49] Superior exploration-exploitation balance in shuffled complex evolution
    Muttil, N
    Liong, SY
    JOURNAL OF HYDRAULIC ENGINEERING, 2004, 130 (12) : 1202 - 1205
  • [50] Interactive Exploration-Exploitation Balancing for Generative Melody Composition
    Zhou, Yijun
    Koyama, Yuki
    Goto, Masataka
    Igarashi, Takeo
    IUI '21 - 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, 2021, : 43 - 47