A causal role of estradiol in human reinforcement learning

被引:7
|
作者
Veselic, Sebastijan [1 ,2 ,3 ]
Jocham, Gerhard [4 ]
Gausterer, Christian [5 ]
Wagner, Bernhard [6 ]
Ernhoefer-Ressler, Miriam [6 ]
Lanzenberger, Rupert [7 ]
Eisenegger, Christoph [1 ]
Lamm, Claus [1 ,8 ]
Vermeer, Annabel Losecaat [1 ,9 ,10 ,11 ]
机构
[1] Univ Vienna, Fac Psychol, Dept Cognit Emot & Methods Psychol, Neuropsychopharmacol & Biopsychol Unit, Vienna, Austria
[2] UCL, Dept Clin & Movement Neurosci, London, England
[3] UCL, Wellcome Ctr Human Neuroimaging, London, England
[4] Heinrich Heine Univ Dusseldorf, Inst Expt Psychol, Biol Psychol Decis Making, Dusseldorf, Germany
[5] Med Univ Vienna, FDZ Forens DNA Zentrallab GmbH, Vienna, Austria
[6] FH JOANNEUM, Lab Chromatog & Spectrometr Anal, Graz, Austria
[7] Med Univ Vienna, Dept Psychiat & Psychotherapy, Vienna, Austria
[8] Univ Vienna, Vienna Cognit Sci Hub, Vienna, Austria
[9] German Inst Human Nutr Potsdam Rehbrucke, Dept Decis Neurosci & Nutr, Nuthetal, Germany
[10] Charite Univ Med Berlin, Berlin, Germany
[11] Humboldt Univ, Freie Univ Berlin, Berlin, Germany
关键词
Estradiol; Reward; Reinforcement learning; DAT1; Dopamine; MENSTRUAL-CYCLE PHASE; DOPAMINE TRANSPORTER AVAILABILITY; SEX-DIFFERENCES; DIFFERENTIAL MODULATION; INDIVIDUAL-DIFFERENCES; WORKING-MEMORY; REWARD SYSTEM; SENSITIVITY; PREDICTION; PUNISHMENT;
D O I
10.1016/j.yhbeh.2021.105022
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The sex hormone estradiol is hypothesized to play a key role in human cognition, and reward processing specifically, via increased dopamine D1-receptor signalling. However, the effect of estradiol on reward processing in men has never been established. To fill this gap, we performed a double-blind placebo-controlled study in which men (N = 100) received either a single dose of estradiol (2 mg) or a placebo. Subjects performed a probabilistic reinforcement learning task where they had to choose between two options with varying reward probabilities to maximize monetary reward. Results showed that estradiol administration increased reward sensitivity compared to placebo. This effect was observed in subjects' choices, how much weight they assigned to their previous choices, and subjective reports about the reward probabilities. Furthermore, effects of estradiol were moderated by reward sensitivity, as measured through the BIS/BAS questionnaire. Using reinforcement learning models, we found that behavioral effects of estradiol were reflected in increased learning rates. These results demonstrate a causal role of estradiol within the framework of reinforcement learning, by enhancing reward sensitivity and learning. Furthermore, they provide preliminary evidence for dopamine-related genetic variants moderating the effect of estradiol on reward processing.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] ReCCoVER: Detecting Causal Confusion for Explainable Reinforcement Learning
    Gajcin, Jasmina
    Dusparic, Ivana
    EXPLAINABLE AND TRANSPARENT AI AND MULTI-AGENT SYSTEMS, EXTRAAMAS 2022, 2022, 13283 : 38 - 56
  • [32] Variable-Agnostic Causal Exploration for Reinforcement Learning
    Minh Hoang Nguyen
    Le, Hung
    Venkatesh, Svetha
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT II, ECML PKDD 2024, 2024, 14942 : 216 - 232
  • [33] Causal Deep Reinforcement Learning Using Observational Data
    Zhu, Wenxuan
    Yu, Chao
    Zhang, Qiang
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 4711 - 4719
  • [34] HCPI-HRL: Human Causal Perception and Inference-driven Hierarchical Reinforcement Learning
    Chen, Bin
    Cao, Zehong
    Mayer, Wolfgang
    Stumptner, Markus
    Kowalczyk, Ryszard
    NEURAL NETWORKS, 2025, 187
  • [36] Role of Dopamine D2 Receptors in Human Reinforcement Learning
    Eisenegger, Christoph
    Naef, Michael
    Linssen, Anke
    Clark, Luke
    Gandamaneni, Praveen K.
    Mueller, Ulrich
    Robbins, Trevor W.
    NEUROPSYCHOPHARMACOLOGY, 2014, 39 (10) : 2366 - 2375
  • [37] Role of Dopamine D2 Receptors in Human Reinforcement Learning
    Christoph Eisenegger
    Michael Naef
    Anke Linssen
    Luke Clark
    Praveen K Gandamaneni
    Ulrich Müller
    Trevor W Robbins
    Neuropsychopharmacology, 2014, 39 : 2366 - 2375
  • [38] ROLE OF REPETITION AND REINFORCEMENT IN LEARNING
    SEIDEL, RJ
    PSYCHOLOGICAL REPORTS, 1963, 13 (03) : 815 - 822
  • [39] Building Minimal and Reusable Causal State Abstractions for Reinforcement Learning
    Wang, Zizhao
    Wang, Caroline
    Xiao, Xuesu
    Zhu, Yuke
    Stone, Peter
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 14, 2024, : 15778 - 15786
  • [40] Causal explanation for reinforcement learning: quantifying state and temporal importance
    Xiaoxiao Wang
    Fanyu Meng
    Xin Liu
    Zhaodan Kong
    Xin Chen
    Applied Intelligence, 2023, 53 : 22546 - 22564