Tell me what you don't know: large language models and the pathologies of intelligence analysis

被引:0
|
作者
Logan, Sarah [1 ]
机构
[1] Australian Natl Univ, Dept Int Relat, Canberra, Australia
关键词
Artificial intelligence (AI); intelligence analysis; large language models;
D O I
10.1080/10357718.2024.2331733
中图分类号
D81 [国际关系];
学科分类号
030207 ;
摘要
This article serves as a warning. Prompted by the likely increase in the reliance on artificial intelligence (AI) in intelligence analysis, it raises grave concerns about the prospect of relying on large language models (LLMs), including in high-stakes contexts such as the state-level resort-to-force decision making that is the focus of this special issue. It begins by identifying the twin informational pathologies that intelligence analysis is subject to by its very nature: information scarcity and epistemic scarcity. It goes on to argue that the use of LLMs would compound these pathologies, attributing this risk to the nature of the international information landscape, especially the rise of private actors in data markets and the changed intelligence environment in the years following September 11. The article concludes by making recommendations for possible responses to the informational risks engendered by the use of LLMs in intelligence analysis, especially in high-stakes contexts.
引用
收藏
页码:220 / 228
页数:9
相关论文
共 50 条
  • [1] Do Large Language Models Know What They Don't Know?
    Yin, Zhangyue
    Sun, Qiushi
    Guo, Qipeng
    Wu, Jiawen
    Qin, Xipeng
    Huang, Xuanjing
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 8653 - 8665
  • [2] You don't know what you don't know
    Thomas, Kym
    MEDICAL JOURNAL OF AUSTRALIA, 2016, 205 (11) : 513 - +
  • [3] You don't know what you don't know
    Dupps, William J., Jr.
    JOURNAL OF CATARACT AND REFRACTIVE SURGERY, 2019, 45 (08): : 1057 - 1058
  • [4] You don't know what you don't know
    Hupp, JR
    ORAL SURGERY ORAL MEDICINE ORAL PATHOLOGY ORAL RADIOLOGY AND ENDODONTICS, 2005, 100 (01): : 1 - 2
  • [5] You don't know me
    Rowland, Kate
    LANCET, 2017, 390 (10114): : 2869 - 2870
  • [6] You don't know me
    Mmolawa, T
    JOURNAL OF ADOLESCENT & ADULT LITERACY, 2001, 45 (02) : 172 - 173
  • [7] 'You Don't Know Me'
    Oppenheimer, M
    NEW YORK TIMES BOOK REVIEW, 2001, : 27 - 27
  • [9] How do you know what you don't know, if you don't know?
    Tucker, RV
    OPERATIVE DENTISTRY, 2003, 28 (02) : 107 - 108
  • [10] Know What You Don't Know
    Webb, Julie
    EDUCATIONAL LEADERSHIP, 2016, 73 (06) : 91 - 91