Aligner2: Enhancing Joint Multiple Intent Detection and Slot Filling via Adjustive and Forced Cross -Task Alignment

被引:0
|
作者
Zhu, Zhihong [1 ]
Cheng, Xuxin [1 ]
Li, Yaowei [1 ]
Li, Hongxiang [1 ]
Zou, Yuexian [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Beijing, Peoples R China
来源
THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17 | 2024年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-intent spoken language understanding (SLU) has garnered growing attention due to its ability to handle multiple intent utterances, which closely mirrors practical scenarios. Unlike traditional SLU, each intent in multi-intent SLU corresponds to its designated scope for slots, which occurs in certain fragments within the utterance. As a result, establishing precise scope alignment to mitigate noise impact emerges as a key challenge in multi-intent SLU. More seriously, they lack alignment between the predictions of the two sub -tasks due to task-independent decoding, resulting in a limitation on the overall performance. To address these challenges, we propose a novel framework termed Aligner(2) for multi-intent SLU, which contains an Adjustive Cross -task Aligner (ACA) and a Forced Cross -task Aligner (FCA). ACA utilizes the information conveyed by joint label embeddings to accurately align the scope of intent and corresponding slots, before the interaction of the two subtasks. FCA introduces reinforcement learning, to enforce the alignment of the task-specific hidden states after the interaction, which is explicitly guided by the prediction. Extensive experiments on two public multi-intent SLU datasets demonstrate the superiority of our Aligner(2) over state-of-the-art methods. More encouragingly, the proposed method Aligner(2) can be easily integrated into existing multi intent SLU frameworks, to further boost performance.
引用
收藏
页码:19777 / 19785
页数:9
相关论文
共 17 条
  • [1] JOINT MULTIPLE INTENT DETECTION AND SLOT FILLING VIA SELF-DISTILLATION
    Chen, Lisong
    Zhou, Peilin
    Zou, Yuexian
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7612 - 7616
  • [2] Task Conditioned BERT for Joint Intent Detection and Slot-Filling
    Tavares, Diogo
    Azevedo, Pedro
    Semedo, David
    Sousa, Ricardo
    Magalhaes, Joao
    PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2023, PT I, 2023, 14115 : 467 - 480
  • [3] Bidirectional Interaction Model for Joint Multiple Intent Detection and Slot Filling
    Li, Shi
    Sun, Zhenpeng
    Computer Engineering and Applications, 2024, 60 (05) : 130 - 138
  • [4] ELSF: Entity-Level Slot Filling Framework for Joint Multiple Intent Detection and Slot Filling
    Zhu, Zhanbiao
    Huang, Peijie
    Huang, Haojing
    Xu, Yuhong
    Lin, Piyuan
    Lao, Leyi
    Chen, Shaoshen
    Xie, Haojie
    Yin, Shangjian
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 4880 - 4893
  • [5] Towards Explainable Joint Models via Information Theory for Multiple Intent Detection and Slot Filling
    Zhuang, Xianwei
    Cheng, Xuxin
    Zou, Yuexian
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 19786 - 19794
  • [6] Joint Slot Filling and Intent Detection via Capsule Neural Networks
    Zhang, Chenwei
    Li, Yaliang
    Du, Nan
    Fan, Wei
    Yu, Philip S.
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 5259 - 5267
  • [7] MISCA: A Joint Model for Multiple Intent Detection and Slot Filling with Intent-Slot Co-Attention
    Pham, Thinh
    Tran, Chi
    Nguyen, Dat Quoc
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 12641 - 12650
  • [8] ACJIS: A Novel Attentive Cross Approach For Joint Intent Detection And Slot Filling
    Yu, Shuai
    Shen, Lei
    Zhu, Pengcheng
    Chen, Jiansong
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [9] Joint Intent Detection and Slot Filling via CNN-LSTM-CRF
    Kane, Bamba
    Rossi, Fabio
    Guinaudeau, Ophelie
    Chiesa, Valeria
    Quenel, Ilhem
    Chau, Stephan
    2020 6TH IEEE CONGRESS ON INFORMATION SCIENCE AND TECHNOLOGY (IEEE CIST'20), 2020, : 342 - 347
  • [10] Accelerating Multiple Intent Detection and Slot Filling via Targeted Knowledge Distillation
    Cheng, Xuxin
    Zhu, Zhihong
    Xu, Wanshi
    Li, Yaowei
    Li, Hongxiang
    Zou, Yuexian
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 8900 - 8910