The Journey of Language Models in Understanding Natural Language

被引：0

作者：

Liu, Yuanrui ^{[1
,2
]}

Zhou, Jingping ^{[3
]}

Sang, Guobiao ^{[2
]}

Huang, Ruilong ^{[1
]}

Zhao, Xinzhe ^{[1
]}

Fang, Jintao ^{[2
]}

Wang, Tiexin ^{[1
]}

Li, Bohan ^{[1
]}

机构：

[1] Nanjing Univ Aeronaut & Astronaut, Coll Artificial Intelligence & Comp Sci & Technol, Nanjing 211106, Peoples R China

[2] Beijing Shenzhou Aerosp Software Technol Co Ltd, Beijing 100094, Peoples R China

[3] Beijing Inst Telemetry, Beijing 100083, Peoples R China

来源：

WEB INFORMATION SYSTEMS AND APPLICATIONS, WISA 2024 | 2024年 / 14883卷

关键词：

Artificial intelligence; Natural language understanding; Vector space model; Topic model; Neural network; Deep learning; VECTOR-SPACE-MODEL;

D O I：

10.1007/978-981-97-7707-5_29

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Since the Turing Test was proposed in the 1950s, humanity began exploring artificial intelligence, with an aim to bridge the interaction gap between machines and human language. This exploration enables machines to comprehend how humans acquire, produce, and understand language, as well as the relationship between linguistic expression and the world. The paper explores the basic principles of natural language representation, the formalization of natural language, and the modeling methods of language models. The paper analyzes, summarizes and compares the mainstream technologies and methods, including vector space-based, topic model-based, graph-based, and neural network-based approaches. And how to improve the development trend and direction of language model understanding ability is predicted and further discussed.

引用

页码：331 / 363

页数：33

共 50 条

[41] Natural Language Understanding for Grading Essay Questions in Persian Language
Mokhtari-Fard, Iman
CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA, 2013, 8208 : 144 - 153
[42] Understanding by Understanding Not: Modeling Negation in Language Models
Hosseini, Arian
Reddy, Siva
Bandanau, Dzmitry
Hjelm, R. Devon
Sordoni, Alessandro
Courville, Aaron
2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 1301 - 1312
[43] Understanding language understanding: Computational models of reading
Dyer, MG
TRENDS IN COGNITIVE SCIENCES, 2000, 4 (01) : 35 - 35
[44] Language understanding using hidden understanding models
Schwartz, R
Miller, S
Stallard, D
Makhoul, J
ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, 1996, : 997 - 1000
[45] GeoLM: Empowering Language Models for Geospatially Grounded Language Understanding
Li, Zekun
Zhou, Wenxuan
Chiang, Yao-Yi
Chen, Muhao
2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 5227 - 5240
[46] Extrapolating Multilingual Language Understanding Models as Multilingual Language Generators
Wu, Bohong
Yuan, Fei
Zhao, Hai
Li, Lei
Xu, Jingjing
FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 15432 - 15444
[47] Challenges in natural language processing and natural language understanding by considering both technical and natural domains
Ardehkhani, Pouya
Vahedi, Amir
Aghababa, Hossein
2023 6TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND IMAGE ANALYSIS, IPRIA, 2023,
[48] UNDERSTANDING NATURAL LANGUAGE - WINOGRAD,T
JONES, KS
INTERNATIONAL JOURNAL OF MAN-MACHINE STUDIES, 1974, 6 (02): : 279 - 281
[49] UNDERSTANDING NATURAL LANGUAGE - WINOGRAD,T
BROWN, JS
BEHAVIORAL SCIENCE, 1973, 18 (06): : 448 - 449
[50] Natural-language understanding at BBN
Weischedel, R
IEEE ANNALS OF THE HISTORY OF COMPUTING, 2006, 28 (01) : 46 - 55

← 1 2 3 4 5 →