The debate over understanding in AI?s large language models

被引:146
作者
Mitchell, Melanie [1 ]
Krakauer, David C. [1 ]
机构
[1] Santa Fe Inst, Santa Fe, NM 87501 USA
基金
美国国家科学基金会;
关键词
artificial intelligence; understanding; large language models;
D O I
10.1073/pnas.2215907120
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We survey a current, heated debate in the artificial intelligence (AI) research community on whether large pretrained language models can be said to understand language-and the physical and social situations language encodes-in any humanlike sense. We describe argu-ments that have been made for and against such under-standing and key questions for the broader sciences of intelligence that have arisen in light of these arguments. We contend that an extended science of intelligence can be developed that will provide insight into distinct modes of understanding, their strengths and limitations, and the challenge of integrating diverse forms of cognition.
引用
收藏
页数:5
相关论文
共 11 条
[1]  
Binz M, 2022, Arxiv, DOI arXiv:2206.14576
[2]   The impact of AlphaFold2 one year on [J].
Jones, David T. ;
Thornton, Janet M. .
NATURE METHODS, 2022, 19 (01) :15-20
[3]   Highly accurate protein structure prediction with AlphaFold [J].
Jumper, John ;
Evans, Richard ;
Pritzel, Alexander ;
Green, Tim ;
Figurnov, Michael ;
Ronneberger, Olaf ;
Tunyasuvunakool, Kathryn ;
Bates, Russ ;
Zidek, Augustin ;
Potapenko, Anna ;
Bridgland, Alex ;
Meyer, Clemens ;
Kohl, Simon A. A. ;
Ballard, Andrew J. ;
Cowie, Andrew ;
Romera-Paredes, Bernardino ;
Nikolov, Stanislav ;
Jain, Rishub ;
Adler, Jonas ;
Back, Trevor ;
Petersen, Stig ;
Reiman, David ;
Clancy, Ellen ;
Zielinski, Michal ;
Steinegger, Martin ;
Pacholska, Michalina ;
Berghammer, Tamas ;
Bodenstein, Sebastian ;
Silver, David ;
Vinyals, Oriol ;
Senior, Andrew W. ;
Kavukcuoglu, Koray ;
Kohli, Pushmeet ;
Hassabis, Demis .
NATURE, 2021, 596 (7873) :583-+
[4]  
Lampinen AK, 2023, Arxiv, DOI [arXiv:2207.07051, 10.48550/arXiv.2207.07051, DOI 10.48550/ARXIV.2207.07051]
[5]  
Laverghetta A., 2022, The Annual Meeting of the Psychometric Society, P151
[6]  
Li BZ, 2021, 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), P1813
[7]  
Olsson Catherine., 2022, arXiv
[8]  
Sadler M., 2019, Game Changer: AlphaZero's Groundbreaking Chess Strategies and the Promise of AI
[9]  
Shanahan M, 2022, Arxiv, DOI [arXiv:2212.03551, DOI 10.48550/ARXIV.2212.03551]
[10]  
Silver D, 2017, Arxiv, DOI [arXiv:1712.01815, DOI 10.48550/ARXIV.1712.01815]