A causal role of estradiol in human reinforcement learning

被引:7
|
作者
Veselic, Sebastijan [1 ,2 ,3 ]
Jocham, Gerhard [4 ]
Gausterer, Christian [5 ]
Wagner, Bernhard [6 ]
Ernhoefer-Ressler, Miriam [6 ]
Lanzenberger, Rupert [7 ]
Eisenegger, Christoph [1 ]
Lamm, Claus [1 ,8 ]
Vermeer, Annabel Losecaat [1 ,9 ,10 ,11 ]
机构
[1] Univ Vienna, Fac Psychol, Dept Cognit Emot & Methods Psychol, Neuropsychopharmacol & Biopsychol Unit, Vienna, Austria
[2] UCL, Dept Clin & Movement Neurosci, London, England
[3] UCL, Wellcome Ctr Human Neuroimaging, London, England
[4] Heinrich Heine Univ Dusseldorf, Inst Expt Psychol, Biol Psychol Decis Making, Dusseldorf, Germany
[5] Med Univ Vienna, FDZ Forens DNA Zentrallab GmbH, Vienna, Austria
[6] FH JOANNEUM, Lab Chromatog & Spectrometr Anal, Graz, Austria
[7] Med Univ Vienna, Dept Psychiat & Psychotherapy, Vienna, Austria
[8] Univ Vienna, Vienna Cognit Sci Hub, Vienna, Austria
[9] German Inst Human Nutr Potsdam Rehbrucke, Dept Decis Neurosci & Nutr, Nuthetal, Germany
[10] Charite Univ Med Berlin, Berlin, Germany
[11] Humboldt Univ, Freie Univ Berlin, Berlin, Germany
关键词
Estradiol; Reward; Reinforcement learning; DAT1; Dopamine; MENSTRUAL-CYCLE PHASE; DOPAMINE TRANSPORTER AVAILABILITY; SEX-DIFFERENCES; DIFFERENTIAL MODULATION; INDIVIDUAL-DIFFERENCES; WORKING-MEMORY; REWARD SYSTEM; SENSITIVITY; PREDICTION; PUNISHMENT;
D O I
10.1016/j.yhbeh.2021.105022
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The sex hormone estradiol is hypothesized to play a key role in human cognition, and reward processing specifically, via increased dopamine D1-receptor signalling. However, the effect of estradiol on reward processing in men has never been established. To fill this gap, we performed a double-blind placebo-controlled study in which men (N = 100) received either a single dose of estradiol (2 mg) or a placebo. Subjects performed a probabilistic reinforcement learning task where they had to choose between two options with varying reward probabilities to maximize monetary reward. Results showed that estradiol administration increased reward sensitivity compared to placebo. This effect was observed in subjects' choices, how much weight they assigned to their previous choices, and subjective reports about the reward probabilities. Furthermore, effects of estradiol were moderated by reward sensitivity, as measured through the BIS/BAS questionnaire. Using reinforcement learning models, we found that behavioral effects of estradiol were reflected in increased learning rates. These results demonstrate a causal role of estradiol within the framework of reinforcement learning, by enhancing reward sensitivity and learning. Furthermore, they provide preliminary evidence for dopamine-related genetic variants moderating the effect of estradiol on reward processing.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Abolishing the effect of reinforcement delay on human causal learning
    Buehner, MJ
    May, J
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 2004, 57 (02): : 179 - 191
  • [2] A Survey on Causal Reinforcement Learning
    Zeng, Yan
    Cai, Ruichu
    Sun, Fuchun
    Huang, Libo
    Hao, Zhifeng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (04) : 5942 - 5962
  • [3] CAUSAL DISCOVERY WITH REINFORCEMENT LEARNING
    Huawei Noah's Ark Lab
    不详
    Int. Conf. Learn. Represent., ICLR,
  • [4] The role of GABAB receptors in human reinforcement learning
    Ort, Andres
    Kometer, Michael
    Rohde, Judith
    Seifritz, Erich
    Vollenweider, Franz X.
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2014, 24 (10) : 1606 - 1614
  • [5] A Role for the Human Substantia Nigra in Reinforcement Learning
    de Berker, Archy O.
    Rutledge, Robb B.
    JOURNAL OF NEUROSCIENCE, 2014, 34 (39): : 12947 - 12949
  • [6] A Causal Role for the Pedunculopontine Nucleus in Human Instrumental Learning
    Skvortsova, Vasilisa
    Palminteri, Stefano
    Buot, Anne
    Karachi, Carine
    Welter, Marie-Laure
    Grabli, David
    Pessiglione, Mathias
    CURRENT BIOLOGY, 2021, 31 (05) : 943 - +
  • [7] Active learning of causal structures with deep reinforcement learning
    Amirinezhad, Amir
    Salehkaleybar, Saber
    Hashemi, Matin
    NEURAL NETWORKS, 2022, 154 : 22 - 30
  • [8] Testosterone and estradiol affect adolescent reinforcement learning
    Kohne, Sina
    Diekhof, Esther K.
    PEERJ, 2022, 10
  • [9] Causal Discovery by Graph Attention Reinforcement Learning
    Yang, Dezhi
    Yu, Guoxian
    Wang, Jun
    Yan, Zhongmin
    Guo, Maozu
    PROCEEDINGS OF THE 2023 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2023, : 28 - 36
  • [10] Explainable Reinforcement Learning through a Causal Lens
    Madumal, Prashan
    Miller, Tim
    Sonenberg, Liz
    Vetere, Frank
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 2493 - 2500