Large language models and humans converge in judging public figures' personalities

被引：0
|
作者：
Cao, Xubo [1 ]
Kosinski, Michal [1 ]
机构：
[1] Stanford Univ, Grad Sch Business, Stanford, CA 94305 USA
来源：
PNAS NEXUS | 2024年 / 3卷 / 10期
关键词：
personality perception; zero-shot predictions; large language models; AI;
D O I：
10.1093/pnasnexus/pgae418
中图分类号：
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号：
07 ; 0710 ; 09 ;
摘要：
ChatGPT-4 and 600 human raters evaluated 226 public figures' personalities using the Ten-Item Personality Inventory. The correlation between ChatGPT-4 and aggregate human ratings ranged from r = 0.76 to 0.87, outperforming the models specifically trained to make such predictions. Notably, the model was not provided with any training data or feedback on its performance. We discuss the potential explanations and practical implications of ChatGPT-4's ability to mimic human responses accurately.
引用
收藏
页数：4
相关论文
共 50 条
  • [1] Large language models know how the personality of public figures is perceived by the general public
    Xubo Cao
    Michal Kosinski
    Scientific Reports, 14
  • [2] Large language models know how the personality of public figures is perceived by the general public
    Cao, Xubo
    Kosinski, Michal
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [3] Contextual feature extraction hierarchies converge in large language models and the brain
    Mischler, Gavin
    Li, Yinghao Aaron
    Bickel, Stephan
    Mehta, Ashesh D.
    Mesgarani, Nima
    NATURE MACHINE INTELLIGENCE, 2024, : 1467 - 1477
  • [4] Inductive reasoning in humans and large language models
    Han, Simon Jerome
    Ransom, Keith J.
    Perfors, Andrew
    Kemp, Charles
    COGNITIVE SYSTEMS RESEARCH, 2024, 83
  • [5] The Language of Creativity: Evidence from Humans and Large Language Models
    Orwig, William
    Edenbaum, Emma R.
    Greene, Joshua D.
    Schacter, Daniel L.
    JOURNAL OF CREATIVE BEHAVIOR, 2024, 58 (01): : 128 - 136
  • [6] Do Multimodal Large Language Models and Humans Ground Language Similarly?
    Jones, Cameron R.
    Bergen, Benjamin
    Trott, Sean
    COMPUTATIONAL LINGUISTICS, 2024, 50 (04) : 1415 - 1440
  • [7] Testing theory of mind in large language models and humans
    Strachan, James W. A.
    Albergo, Dalila
    Borghini, Giulia
    Pansardi, Oriana
    Scaliti, Eugenio
    Gupta, Saurabh
    Saxena, Krati
    Rufo, Alessandro
    Panzeri, Stefano
    Manzi, Guido
    Graziano, Michael S. A.
    Becchio, Cristina
    NATURE HUMAN BEHAVIOUR, 2024, 8 (07): : 1285 - 1295
  • [8] Do Large Language Models Know What Humans Know?
    Trott, Sean
    Jones, Cameron
    Chang, Tyler
    Michaelov, James
    Bergen, Benjamin
    COGNITIVE SCIENCE, 2023, 47 (07)
  • [9] Evaluating the Language Abilities of Large Language Models vs. Humans: Three Caveats
    Leivada, Evelina
    Dentella, Vittoria
    Guenther, Fritz
    BIOLINGUISTICS, 2024, 18
  • [10] Large language models can outperform humans in social situational judgments
    Mittelstaedt, Justin M.
    Maier, Julia
    Goerke, Panja
    Zinn, Frank
    Hermes, Michael
    SCIENTIFIC REPORTS, 2024, 14 (01):
12345