Large language models and humans converge in judging public figures' personalities

被引：0
|
作者：
Cao, Xubo [1 ]
Kosinski, Michal [1 ]
机构：
[1] Stanford Univ, Grad Sch Business, Stanford, CA 94305 USA
来源：
PNAS NEXUS | 2024年 / 3卷 / 10期
关键词：
personality perception; zero-shot predictions; large language models; AI;
D O I：
10.1093/pnasnexus/pgae418
中图分类号：
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号：
07 ; 0710 ; 09 ;
摘要：
ChatGPT-4 and 600 human raters evaluated 226 public figures' personalities using the Ten-Item Personality Inventory. The correlation between ChatGPT-4 and aggregate human ratings ranged from r = 0.76 to 0.87, outperforming the models specifically trained to make such predictions. Notably, the model was not provided with any training data or feedback on its performance. We discuss the potential explanations and practical implications of ChatGPT-4's ability to mimic human responses accurately.
引用
收藏
页数：4
相关论文
共 50 条
  • [21] Adaptation of Large Language Models for the Public Sector: A Clustering Use Case
    Caudron, Emilien
    Ghesquiere, Nathan
    Travers, Wouter
    Balahur, Alexandra
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS, PT II, NLDB 2024, 2024, 14763 : 327 - 340
  • [22] Large Language Models are Not Models of Natural Language: They are Corpus Models
    Veres, Csaba
    IEEE ACCESS, 2022, 10 : 61970 - 61979
  • [23] Large Language Models
    Vargas, Diego Collarana
    Katsamanis, Nassos
    ERCIM NEWS, 2024, (136): : 12 - 13
  • [24] Large Language Models
    Cerf, Vinton G.
    COMMUNICATIONS OF THE ACM, 2023, 66 (08) : 7 - 7
  • [25] Humans vs. large language models: Judgmental forecasting in an era of advanced AI
    Abolghasemi, Mahdi
    Ganbold, Odkhishig
    Rotaru, Kristian
    INTERNATIONAL JOURNAL OF FORECASTING, 2025, 41 (02) : 631 - 648
  • [26] Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies
    Aher, Gati
    Arriaga, Rosa I.
    Kalai, Adam Tauman
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202 : 337 - 371
  • [27] Developing conversational Virtual Humans for social emotion elicitation based on large language models
    Llanes-Jurado, Jose
    Gomez-Zaragoza, Lucia
    Minissi, Maria Eleonora
    Alcaniz, Mariano
    Marin-Morales, Javier
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 246
  • [28] Is the Machine Surpassing Humans?: Large Language Models, Structuralism, and Liturgical Ritual: A Position Paper
    Barnard, Marcel
    Otte, Wim
    INTERNATIONAL JOURNAL OF PRACTICAL THEOLOGY, 2024, 28 (02) : 289 - 306
  • [29] Aligning Large Language Models with Humans: A Comprehensive Survey of ChatGPT's Aptitude in Pharmacology
    Zhang, Yingbo
    Ren, Shumin
    Wang, Jiao
    Lu, Junyu
    Wu, Cong
    He, Mengqiao
    Liu, Xingyun
    Wu, Rongrong
    Zhao, Jing
    Zhan, Chaoying
    Du, Dan
    Zhan, Zhajun
    Singla, Rajeev K.
    Shen, Bairong
    DRUGS, 2025, 85 (02) : 231 - 254
  • [30] Exploring large language models for human mobility prediction under public events
    Liang, Yuebing
    Liu, Yichao
    Wang, Xiaohan
    Zhao, Zhan
    COMPUTERS ENVIRONMENT AND URBAN SYSTEMS, 2024, 112
12345