Shortcut Learning of Large Language Models in Natural Language Understanding

被引：13
|
作者：
Du, Mengnan [1 ]
He, Fengxiang [2 ]
Zou, Na [3 ]
Tao, Dacheng [4 ]
Hu, Xia [5 ]
机构：
[1] New Jersey Inst Technol, Dept Data Sci, Newark, NJ 07102 USA
[2] Univ Edinburgh, Sch Informat, Edinburgh, Scotland
[3] Texas A&M Univ, Engn Technol & Ind Distribut, College Stn, TX USA
[4] Univ Sydney, Comp Sci, Sydney, Australia
[5] Rice Univ, Comp Sci, Houston, TX USA
来源：
COMMUNICATIONS OF THE ACM | 2024年 / 67卷 / 01期
关键词：
D O I：
10.1145/3596490
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
Shortcuts often hinder the robustness of large language models. © 2023 ACM.
引用
收藏
页码：110 / 120
页数：11
相关论文
共 50 条
  • [31] Understanding Naturalistic Facial Expressions with Deep Learning and Multimodal Large Language Models
    Bian, Yifan
    Kuester, Dennis
    Liu, Hui
    Krumhuber, Eva G.
    SENSORS, 2024, 24 (01)
  • [32] Shortcut Learning Explanations for Deep Natural Language Processing: A Survey on Dataset Biases
    Dogra, Varun
    Verma, Sahil
    Kavita
    Wozniak, Marcin
    Shafi, Jana
    Ijaz, Muhammad Fazal
    IEEE ACCESS, 2024, 12 : 26183 - 26195
  • [33] Understanding Learning Dynamics Of Language Models with SVCCA
    Saphra, Naomi
    Lopez, Adam
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 3257 - 3267
  • [34] The language of thought and natural language understanding
    Knowles, J
    ANALYSIS, 1998, 58 (04) : 264 - 272
  • [35] Effect of Visual Extensions on Natural Language Understanding in Vision-and-Language Models
    Iki, Taichi
    Aizawa, Akiko
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 2189 - 2196
  • [36] Are Large Language Models Ready for Healthcare? A Comparative Study on Clinical Language Understanding
    Wang, Yuqing
    Zhao, Yun
    Petzold, Linda
    MACHINE LEARNING FOR HEALTHCARE CONFERENCE, VOL 219, 2023, 219
  • [37] Using Natural Sentences for Understanding Biases in Language Models
    Alnegheimish, Sarah
    Guo, Alicia
    Sun, Yi
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 2824 - 2830
  • [38] The use of the natural language understanding agents with conceptual models
    Vasilecas, Olegas
    Laukaitis, Algirdas
    ICEIS 2006: PROCEEDINGS OF THE EIGHTH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS: ARTIFICIAL INTELLIGENCE AND DECISION SUPPORT SYSTEMS, 2006, : 308 - 311
  • [39] Natural Language Understanding and Prediction: from Formal Grammars to Large Scale Machine Learning
    Duta, Nicolae
    FUNDAMENTA INFORMATICAE, 2014, 131 (3-4) : 425 - 440
  • [40] Natural Language Understanding
    Di Sciullo, Anna Maria
    NEW TRENDS IN SOFTWARE METHODOLOGIES, TOOLS AND TECHNIQUES, 2009, 199 : 551 - 563
12345