Joint Intent Detection and Slot Filling via CNN-LSTM-CRF

被引:0
|
作者
Kane, Bamba [1 ]
Rossi, Fabio [1 ]
Guinaudeau, Ophelie [1 ]
Chiesa, Valeria [1 ]
Quenel, Ilhem [1 ]
Chau, Stephan [1 ]
机构
[1] Altran, Res & Innovat Direct, Sophia Antipolis, France
关键词
Spoken Language Understanding; Intent detection; Slot filling; Recurrent Neural Networks; Convolutional Neural Networks; CONVOLUTIONAL NEURAL-NETWORKS;
D O I
10.1109/CIST49399.2021.9357183
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Intent detection and slot filling are two main tasks in the domain of Spoken Language Understanding (SLU). The methods employed may treat the intent detection and slot filling as two independent tasks or use a joint model. Using a joint model takes into account the cross impact between the two tasks. In this article, we introduce CoBiC a new model combining CNN (Convolutional Neural Network), Bidirectional LSTM (Long Short-Term Memory) and CRF (Conditional Random Field) to extract the intents and the related slots. The same architecture of CoBiC can either be used as an independent model or joint model for intent detection and slot filling. Our method improves the state-of-the-art results on ATIS (Airline Travel Information Systems) benchmark. We also apply our model on a private dataset consisting of clients requests to a vocal assistant. The results demonstrate that CoBiC has strong generalization capability.
引用
收藏
页码:342 / 347
页数:6
相关论文
共 50 条
  • [1] Neural Chinese Named Entity Recognition via CNN-LSTM-CRF and Joint Training with Word Segmentation
    Wu, Fangzhao
    Liu, Junxin
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 3342 - 3348
  • [2] CONVOLUTIONAL NEURAL NETWORK BASED TRIANGULAR CRF FOR JOINT INTENT DETECTION AND SLOT FILLING
    Xu, Puyang
    Sarikaya, Ruhi
    2013 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING (ASRU), 2013, : 78 - 83
  • [3] Joint Slot Filling and Intent Detection via Capsule Neural Networks
    Zhang, Chenwei
    Li, Yaliang
    Du, Nan
    Fan, Wei
    Yu, Philip S.
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 5259 - 5267
  • [4] Chinese Clinical Entity Recognition via Attention-based CNN-LSTM-CRF
    Liu, Zengjian
    Wang, Xiaolong
    Chen, Qingcai
    Tang, Buzhou
    2018 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS WORKSHOPS (ICHI-W), 2018, : 68 - 69
  • [5] JOINT MULTIPLE INTENT DETECTION AND SLOT FILLING VIA SELF-DISTILLATION
    Chen, Lisong
    Zhou, Peilin
    Zou, Yuexian
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7612 - 7616
  • [6] End-to-end masked graph-based CRF for joint slot filling and intent detection
    Tang, Hao
    Ji, Donghong
    Zhou, Qiji
    NEUROCOMPUTING, 2020, 413 (413) : 348 - 359
  • [7] CNN-LSTM-CRF for Aspect-Based Sentiment Analysis: A Joint Method Applied to French Reviews
    Kane, Bamba
    Jrad, Ali
    Essebbar, Abderrahman
    Guinaudeau, Ophelie
    Chiesa, Valeria
    Quenel, Ilhem
    Chau, Stephane
    ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 1, 2021, : 498 - 505
  • [8] Joint intent detection and slot filling with syntactic and semantic features using multichannel CNN-BiLSTM
    Muhammad, Yusuf Idris
    Salim, Naomie
    Zainal, Anazida
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [9] Joint intent detection and slot filling with syntactic and semantic features using multichannel CNN-BiLSTM
    Muhammad, Yusuf Idris
    Salim, Naomie
    Zainal, Anazida
    PeerJ Computer Science, 2024, 10
  • [10] WAIS: Word Attention for Joint Intent Detection and Slot Filling
    Chen, Sixuan
    Yu, Shuai
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9927 - 9928