Large language models and humans converge in judging public figures' personalities

被引:0
|
作者
Cao, Xubo [1 ]
Kosinski, Michal [1 ]
机构
[1] Stanford Univ, Grad Sch Business, Stanford, CA 94305 USA
来源
PNAS NEXUS | 2024年 / 3卷 / 10期
关键词
personality perception; zero-shot predictions; large language models; AI;
D O I
10.1093/pnasnexus/pgae418
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
ChatGPT-4 and 600 human raters evaluated 226 public figures' personalities using the Ten-Item Personality Inventory. The correlation between ChatGPT-4 and aggregate human ratings ranged from r = 0.76 to 0.87, outperforming the models specifically trained to make such predictions. Notably, the model was not provided with any training data or feedback on its performance. We discuss the potential explanations and practical implications of ChatGPT-4's ability to mimic human responses accurately.
引用
收藏
页数:4
相关论文
共 50 条
  • [41] Large language models and psychiatry
    Orru, Graziella
    Melis, Giulia
    Sartori, Giuseppe
    INTERNATIONAL JOURNAL OF LAW AND PSYCHIATRY, 2025, 101
  • [42] Large Language Models in Cyberattacks
    S. V. Lebed
    D. E. Namiot
    E. V. Zubareva
    P. V. Khenkin
    A. A. Vorobeva
    D. A. Svichkar
    Doklady Mathematics, 2024, 110 (Suppl 2) : S510 - S520
  • [43] Autoformalization with Large Language Models
    Wu, Yuhuai
    Jiang, Albert Q.
    Li, Wenda
    Rabe, Markus N.
    Staats, Charles
    Jamnik, Mateja
    Szegedy, Christian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [44] Imitation and Large Language Models
    Boisseau, Eloise
    MINDS AND MACHINES, 2024, 34 (04)
  • [45] The Smallness of Large Language Models
    Denning, Peter J.
    COMMUNICATIONS OF THE ACM, 2023, 66 (09) : 24 - 27
  • [46] Large language models in medicine
    Thirunavukarasu, Arun James
    Ting, Darren Shu Jeng
    Elangovan, Kabilan
    Gutierrez, Laura
    Tan, Ting Fang
    Ting, Daniel Shu Wei
    NATURE MEDICINE, 2023, 29 (08) : 1930 - 1940
  • [47] Large language models in medicine
    Arun James Thirunavukarasu
    Darren Shu Jeng Ting
    Kabilan Elangovan
    Laura Gutierrez
    Ting Fang Tan
    Daniel Shu Wei Ting
    Nature Medicine, 2023, 29 : 1930 - 1940
  • [48] Editorial on large language models
    Deibert, Christopher M.
    TRANSLATIONAL ANDROLOGY AND UROLOGY, 2024, 13 (05) : 897 - 898
  • [49] On Finetuning Large Language Models
    Wang, Yu
    POLITICAL ANALYSIS, 2023,
  • [50] Large Language Models and Psychoeducation
    Kleebayoon, Amnuay
    Wiwanitkit, Viroj
    JOURNAL OF ECT, 2024, 40 (01) : e1 - e1