A causal role of estradiol in human reinforcement learning

被引:7
|
作者
Veselic, Sebastijan [1 ,2 ,3 ]
Jocham, Gerhard [4 ]
Gausterer, Christian [5 ]
Wagner, Bernhard [6 ]
Ernhoefer-Ressler, Miriam [6 ]
Lanzenberger, Rupert [7 ]
Eisenegger, Christoph [1 ]
Lamm, Claus [1 ,8 ]
Vermeer, Annabel Losecaat [1 ,9 ,10 ,11 ]
机构
[1] Univ Vienna, Fac Psychol, Dept Cognit Emot & Methods Psychol, Neuropsychopharmacol & Biopsychol Unit, Vienna, Austria
[2] UCL, Dept Clin & Movement Neurosci, London, England
[3] UCL, Wellcome Ctr Human Neuroimaging, London, England
[4] Heinrich Heine Univ Dusseldorf, Inst Expt Psychol, Biol Psychol Decis Making, Dusseldorf, Germany
[5] Med Univ Vienna, FDZ Forens DNA Zentrallab GmbH, Vienna, Austria
[6] FH JOANNEUM, Lab Chromatog & Spectrometr Anal, Graz, Austria
[7] Med Univ Vienna, Dept Psychiat & Psychotherapy, Vienna, Austria
[8] Univ Vienna, Vienna Cognit Sci Hub, Vienna, Austria
[9] German Inst Human Nutr Potsdam Rehbrucke, Dept Decis Neurosci & Nutr, Nuthetal, Germany
[10] Charite Univ Med Berlin, Berlin, Germany
[11] Humboldt Univ, Freie Univ Berlin, Berlin, Germany
关键词
Estradiol; Reward; Reinforcement learning; DAT1; Dopamine; MENSTRUAL-CYCLE PHASE; DOPAMINE TRANSPORTER AVAILABILITY; SEX-DIFFERENCES; DIFFERENTIAL MODULATION; INDIVIDUAL-DIFFERENCES; WORKING-MEMORY; REWARD SYSTEM; SENSITIVITY; PREDICTION; PUNISHMENT;
D O I
10.1016/j.yhbeh.2021.105022
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The sex hormone estradiol is hypothesized to play a key role in human cognition, and reward processing specifically, via increased dopamine D1-receptor signalling. However, the effect of estradiol on reward processing in men has never been established. To fill this gap, we performed a double-blind placebo-controlled study in which men (N = 100) received either a single dose of estradiol (2 mg) or a placebo. Subjects performed a probabilistic reinforcement learning task where they had to choose between two options with varying reward probabilities to maximize monetary reward. Results showed that estradiol administration increased reward sensitivity compared to placebo. This effect was observed in subjects' choices, how much weight they assigned to their previous choices, and subjective reports about the reward probabilities. Furthermore, effects of estradiol were moderated by reward sensitivity, as measured through the BIS/BAS questionnaire. Using reinforcement learning models, we found that behavioral effects of estradiol were reflected in increased learning rates. These results demonstrate a causal role of estradiol within the framework of reinforcement learning, by enhancing reward sensitivity and learning. Furthermore, they provide preliminary evidence for dopamine-related genetic variants moderating the effect of estradiol on reward processing.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Explainable Reinforcement Learning via a Causal World Model
    Yu, Zhongwei
    Ruan, Jingqing
    Xing, Dengpeng
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 4540 - 4548
  • [22] Combining Reinforcement Learning and Causal Models for Robotics Applications
    Mendez-Molina, Arquimides
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4905 - 4906
  • [23] A Meta-Reinforcement Learning Algorithm for Causal Discovery
    Sauter, Andreas
    Acar, Erman
    Francois-Lavet, Vincent
    CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 602 - 619
  • [24] Causal Reinforcement Learning in Iterated Prisoner's Dilemma
    Kazemi, Yosra
    Chanel, Caroline P. C.
    Givigi, Sidney
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (02) : 2523 - 2534
  • [25] Reinforcement Learning of Causal Variables Using Mediation Analysis
    Herlau, Tue
    Larsen, Rasmus
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 6910 - 6917
  • [26] Stochastic intervention for causal inference via reinforcement learning
    Duong, Tri Dung
    Li, Qian
    Xu, Guandong
    NEUROCOMPUTING, 2022, 482 : 40 - 49
  • [27] Causal Influence Detection for Improving Efficiency in Reinforcement Learning
    Seitzer, Maximilian
    Schoelkopf, Bernhard
    Martius, Georg
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [28] Causal Based Action Selection Policy for Reinforcement Learning
    Feliciano-Avelino, Ivan
    Mendez-Molina, Arquimides
    Morales, Eduardo F.
    Enrique Sucar, L.
    ADVANCES IN COMPUTATIONAL INTELLIGENCE (MICAI 2021), PT I, 2021, 13067 : 213 - 227
  • [29] Interpretable Reward Redistribution in Reinforcement Learning: A Causal Approach
    Zhang, Yudi
    Du, Yali
    Huang, Biwei
    Wang, Ziyan
    Wang, Jun
    Fang, Meng
    Pechenizkiy, Mykola
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [30] Maximum causal entropy inverse constrained reinforcement learning
    Baert, Mattijs
    Mazzaglia, Pietro
    Leroux, Sam
    Simoens, Pieter
    MACHINE LEARNING, 2025, 114 (04)