Margin and Shared Proxies: Advanced Proxy Anchor Loss for Out-of-Domain Intent Classification

被引:0
|
作者
Park, Junhyeong [1 ]
Kim, Byeonghun [1 ]
Han, Sangkwon [1 ]
Ji, Seungbin [1 ]
Rhee, Jongtae [1 ]
机构
[1] Dongguk Univ, Dept Ind & Syst Engn, Seoul 04620, South Korea
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 06期
关键词
deep learning; dialog system; metric learning; natural language processing; out-of-domain intent classification; text classification;
D O I
10.3390/app14062312
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Out-of-Domain (OOD) intent classification is an important task for a dialog system, as it allows for appropriate responses to be generated. Previous studies aiming to solve the OOD intent classification task have generally adopted metric learning methods to generate decision boundaries in the embedding space. However, these existing methods struggle to capture the high-dimensional semantic features of data, as they learn decision boundary using scalar distances. They also use generated OOD samples for learning. However, such OOD samples are biased, and they cannot include all real-world OOD intents, thus representing a limitation. In the current paper, we attempt to overcome these challenges by using Advanced Proxy-Anchor loss, which introduces a margin proxy and shared proxy. First, to generate a decision boundary that has the high-dimensional semantic features of training data, we use a margin proxy for learnable embedding vectors. Next, the shared proxy, which is shared by all In-Domain (IND) samples, is introduced to make it possible to learn the discriminative feature between IND intents and OOD intent, ultimately leading to the improved classification of OOD samples. We conduct evaluations of the proposed method using three benchmark datasets. The experimental results demonstrate that our method achieved an improved performance compared to the methods described in previous studies.
引用
收藏
页数:14
相关论文
共 21 条
  • [21] Improving Matching Efficiency and Out-of-domain Reliability of Underwater Gravity Matching Navigation Based on a Novel Soft-margin Local Semicircular-domain Re-searching Model
    Zhao, Shijie
    Zheng, Wei
    Li, Zhaowei
    Zhu, Huizhong
    Xu, Aigong
    REMOTE SENSING, 2022, 14 (09)