An Effective Natural Language Understanding Model using Deep Learning and PyDial Toolkit

被引:0
|
作者
Ganesan, Karthik [1 ]
Patil, Akhilesh P. [1 ]
机构
[1] Ramaiah Inst Technol, Dept Comp Sci & Engn, Bengaluru, India
关键词
Long Short-Term Memory Networkst; Bidirectional Long-Short Term Memory Networks - LSTM; Word Embeddings; Inside Out Beginning Tag; User Goal; Ontology; Natural Language Understanding;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the current world, where we want spoken dialogue systems, to understand natural language utterances by human beings in a very much human way, an effective natural language understanding model plays a crucial role. In the model, we have proposed and used bi-directional LSTM (Long short-term memory network) based Recurrent neural network for slot identification, and we have developed an ontology for a subset of ATIS airlines dataset, describing the slots under different categories (request able, user-request able, in formable) to guide the Spoken dialogue system to help the user finish the task. The novelty in this research comes from the fact that a complete methodology has been proposed to build the NLU model for any domain based on deep learning which can understand utterances in simpler context and understand multi-word slots. With the following methodology, a natural language understanding model can be built for a spoken dialogue system for any domain. In the proposed model, the bi directional lstm model obtained had an accuracy of over 86%. The proposed technique is easy to use and can be helpful in building basic voice based search agents for any domain with good performance.
引用
收藏
页码:810 / 816
页数:7
相关论文
共 50 条
  • [31] BERT Model-based Natural Language to NoSQL Query Conversion using Deep Learning Approach
    Hossen, Kazi Mojammel
    Uddin, Mohammed Nasir
    Arefin, Minhazul
    Uddin, Md Ashraf
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (02) : 810 - 821
  • [32] Shortcut Learning of Large Language Models in Natural Language Understanding
    Du, Mengnan
    He, Fengxiang
    Zou, Na
    Tao, Dacheng
    Hu, Xia
    COMMUNICATIONS OF THE ACM, 2024, 67 (01) : 110 - 120
  • [33] Intent Detection for Spoken Language Understanding Using a Deep Ensemble Model
    Firdaus, Mauajama
    Bhatnagar, Shobhit
    Ekbal, Asif
    Bhattacharyya, Pushpak
    PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 629 - 642
  • [34] Application of Deep Belief Networks for Natural Language Understanding
    Sarikaya, Ruhi
    Hinton, Geoffrey E.
    Deoras, Anoop
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (04) : 778 - 784
  • [35] Temporal Relationship Extraction for Natural Language Texts by Using Deep Bidirectional Language Model
    Lim, Chae-Gyun
    Choi, Ho-Jin
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 555 - 557
  • [36] A deep learning model for natural language querying in Cyber-Physical Systems
    Llopis, Juan Alberto
    Fernandez-Garcia, Antonio Jesus
    Criado, Javier
    Iribarne, Luis
    Ayala, Rosa
    Wang, James Z.
    INTERNET OF THINGS, 2023, 24
  • [37] Deep Learning Methods in Natural Language Processing
    Flores, Alexis Stalin Alulema
    APPLIED TECHNOLOGIES (ICAT 2019), PT II, 2020, 1194 : 92 - 107
  • [38] Deep Learning on Graphs for Natural Language Processing
    Wu, Lingfei
    Chen, Yu
    Ji, Heng
    Liu, Bang
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 4084 - 4085
  • [39] Natural Language Interfaces for Databases with Deep Learning
    Katsogiannis-Meimarakis, George
    Xydas, Mike
    Koutrika, Georgia
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 16 (12): : 3878 - 3881
  • [40] Deep Structured Learning for Natural Language Processing
    Li, Yong
    Yang, Xiaojun
    Zuo, Min
    Jin, Qingyu
    Li, Haisheng
    Cao, Qian
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (03)