Joint Intent Detection and Slot Filling via CNN-LSTM-CRF

被引:0
|
作者
Kane, Bamba [1 ]
Rossi, Fabio [1 ]
Guinaudeau, Ophelie [1 ]
Chiesa, Valeria [1 ]
Quenel, Ilhem [1 ]
Chau, Stephan [1 ]
机构
[1] Altran, Res & Innovat Direct, Sophia Antipolis, France
来源
2020 6TH IEEE CONGRESS ON INFORMATION SCIENCE AND TECHNOLOGY (IEEE CIST'20) | 2020年
关键词
Spoken Language Understanding; Intent detection; Slot filling; Recurrent Neural Networks; Convolutional Neural Networks; CONVOLUTIONAL NEURAL-NETWORKS;
D O I
10.1109/CIST49399.2021.9357183
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Intent detection and slot filling are two main tasks in the domain of Spoken Language Understanding (SLU). The methods employed may treat the intent detection and slot filling as two independent tasks or use a joint model. Using a joint model takes into account the cross impact between the two tasks. In this article, we introduce CoBiC a new model combining CNN (Convolutional Neural Network), Bidirectional LSTM (Long Short-Term Memory) and CRF (Conditional Random Field) to extract the intents and the related slots. The same architecture of CoBiC can either be used as an independent model or joint model for intent detection and slot filling. Our method improves the state-of-the-art results on ATIS (Airline Travel Information Systems) benchmark. We also apply our model on a private dataset consisting of clients requests to a vocal assistant. The results demonstrate that CoBiC has strong generalization capability.
引用
收藏
页码:342 / 347
页数:6
相关论文
共 50 条
  • [21] A Graph-to-Sequence Model for Joint Intent Detection and Slot Filling
    Wu, Jie
    Harris, Ian G.
    Zhao, Hongzhi
    Ling, Guangming
    2023 IEEE 17TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING, ICSC, 2023, : 131 - 138
  • [22] Joint intent detection and slot filling for Turkish natural language understanding
    Buyuk, Osman
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2023, 31 (05) : 844 - 859
  • [23] Task Conditioned BERT for Joint Intent Detection and Slot-Filling
    Tavares, Diogo
    Azevedo, Pedro
    Semedo, David
    Sousa, Ricardo
    Magalhaes, Joao
    PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2023, PT I, 2023, 14115 : 467 - 480
  • [24] SLIM: EXPLICIT SLOT-INTENT MAPPING WITH BERT FOR JOINT MULTI-INTENT DETECTION AND SLOT FILLING
    Cai, Fengyu
    Zhou, Wanhao
    Mi, Fei
    Faltings, Boi
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7607 - 7611
  • [25] MISCA: A Joint Model for Multiple Intent Detection and Slot Filling with Intent-Slot Co-Attention
    Pham, Thinh
    Tran, Chi
    Nguyen, Dat Quoc
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 12641 - 12650
  • [26] Intent Detection and Slot Filling for Vietnamese
    Mai Hoang Dao
    Thinh Hung Truong
    Dat Quoc Nguyen
    INTERSPEECH 2021, 2021, : 4698 - 4702
  • [27] Joint model of intent detection and slot filling of knowledge question for crop diseases and pests using CNN-Transformer
    Wang, Lu
    Liu, Ruilin
    Huang, Jingzhong
    Guo, Xuchao
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2024, 40 (13): : 156 - 162
  • [28] Entity recognition in Chinese clinical text using attention-based CNN-LSTM-CRF
    Tang, Buzhou
    Wang, Xiaolong
    Yan, Jun
    Chen, Qingcai
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2019, 19 (Suppl 3)
  • [29] Entity recognition in Chinese clinical text using attention-based CNN-LSTM-CRF
    Buzhou Tang
    Xiaolong Wang
    Jun Yan
    Qingcai Chen
    BMC Medical Informatics and Decision Making, 19
  • [30] Joint intent detection and slot filling with wheel-graph attention networks
    Wei, Pengfei
    Zeng, Bi
    Liao, Wenxiong
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (03) : 2409 - 2420