Proselfs depend more on model-based than model-free learning in a non-social probabilistic state-transition task

被引:0
|
作者
Oguchi, Mineki [1 ]
Li, Yang [1 ,2 ]
Matsumoto, Yoshie [1 ,3 ]
Kiyonari, Toko [4 ]
Yamamoto, Kazuhiko [5 ]
Sugiura, Shigeki [5 ]
Sakagami, Masamichi [1 ]
机构
[1] Tamagawa Univ, Brain Sci Inst, 6 1 1 Tamagawagakuen, Machida, Tokyo, Japan
[2] Nagoya Univ, Grad Sch Informat, Nagoya, Japan
[3] Seinan Gakuin Univ, Fac Human Sci, Dept Psychol, Fukuoka, Japan
[4] Aoyama Gakuin Univ, Sch Social Informat, Sagamihara, Kanagawa, Japan
[5] Genesis Res Inst, Nagoya, Aichi, Japan
关键词
SOCIAL VALUE ORIENTATION; DECISION-MAKING; MECHANISMS; FOUNDATIONS; COOPERATION; ARBITRATION; INFERENCE; REWARDS; SYSTEMS;
D O I
10.1038/s41598-023-27609-0
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Humans form complex societies in which we routinely engage in social decision-making regarding the allocation of resources among ourselves and others. One dimension that characterizes social decision-making in particular is whether to prioritize self-interest or respect for others-proself or prosocial. What causes this individual difference in social value orientation? Recent developments in the social dual-process theory argue that social decision-making is characterized by its underlying domain-general learning systems: the model-free and model-based systems. In line with this "learning" approach, we propose and experimentally test the hypothesis that differences in social preferences stem from which learning system is dominant in an individual. Here, we used a non-social state transition task that allowed us to assess the balance between model-free/model-based learning and investigate its relation to the social value orientations. The results showed that proselfs depended more on model-based learning, whereas prosocials depended more on model-free learning. Reward amount and reaction time analyses showed that proselfs learned the task structure earlier in the session than prosocials, reflecting their difference in model-based/model-free learning dependence. These findings support the learning hypothesis on what makes differences in social preferences and have implications for understanding the mechanisms of prosocial behavior.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Dyna-style Model-based reinforcement learning with Model-Free Policy Optimization
    Dong, Kun
    Luo, Yongle
    Wang, Yuxin
    Liu, Yu
    Qu, Chengeng
    Zhang, Qiang
    Cheng, Erkang
    Sun, Zhiyong
    Song, Bo
    KNOWLEDGE-BASED SYSTEMS, 2024, 287
  • [42] The modulation of acute stress on model-free and model-based reinforcement learning in gambling disorder
    Wyckmans, Florent
    Banerjee, Nilosmita
    Saeremans, Melanie
    Otto, Ross
    Kornreich, Charles
    Vanderijst, Laetitia
    Gruson, Damien
    Carbone, Vincenzo
    Bechara, Antoine
    Buchanan, Tony
    Noel, Xavier
    JOURNAL OF BEHAVIORAL ADDICTIONS, 2022, 11 (03) : 831 - 844
  • [43] Effects of subclinical depression on prefrontal-striatal model-based and model-free learning
    Heo, Suyeon
    Sung, Yoondo
    Lee, Sang Wan
    PLOS COMPUTATIONAL BIOLOGY, 2021, 17 (05)
  • [44] Alcohol Hangover Does Not Alter the Application of Model-Based and Model-Free Learning Strategies
    Berghaeuser, Julia
    Bensmann, Wiebke
    Zink, Nicolas
    Endrass, Tanja
    Beste, Christian
    Stock, Ann-Kathrin
    JOURNAL OF CLINICAL MEDICINE, 2020, 9 (05)
  • [45] Toward an Understanding of Dynamic Moral Decision Making: Model-Free and Model-Based Learning
    Christopoulos, George I.
    Liu, Xiao-Xiao
    Hong, Ying-yi
    JOURNAL OF BUSINESS ETHICS, 2017, 144 (04) : 699 - 715
  • [46] The role of training variability for model-based and model-free learning of an arbitrary visuomotor mapping
    Velazquez-Vargas, Carlos A.
    Daw, Nathaniel D.
    Taylor, Jordan A.
    PLOS COMPUTATIONAL BIOLOGY, 2024, 20 (09)
  • [47] Toward an Understanding of Dynamic Moral Decision Making: Model-Free and Model-Based Learning
    George I. Christopoulos
    Xiao-Xiao Liu
    Ying-yi Hong
    Journal of Business Ethics, 2017, 144 : 699 - 715
  • [48] The involvement of model-based but not model-free learning signals during observational reward learning in the absence of choice
    Dunne, Simon
    D'Souza, Arun
    O'Doherty, John P.
    JOURNAL OF NEUROPHYSIOLOGY, 2016, 115 (06) : 3195 - 3203
  • [49] Biases in estimating the balance between model-free and model-based learning systems due to model misspecification
    Toyama, Asako
    Katahira, Kentaro
    Ohira, Hideki
    JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2019, 91 : 88 - 102
  • [50] Learning explainable task-relevant state representation for model-free deep reinforcement learning
    Zhao, Tingting
    Li, Guixi
    Zhao, Tuo
    Chen, Yarui
    Xie, Ning
    Niu, Gang
    Sugiyama, Masashi
    NEURAL NETWORKS, 2024, 180