DPNet: domain-aware prototypical network for interdisciplinary few-shot relation classification

被引:4
|
作者
Lv, Bo [1 ,2 ,3 ]
Jin, Li [1 ,2 ]
Li, Xiaoyu [1 ,2 ]
Sun, Xian [1 ,2 ]
Guo, Zhi [1 ,2 ]
Zhang, Zequn [1 ,2 ]
Li, Shuchao [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Inst Elect, Key Lab Network Informat Syst Technol, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
关键词
Domain-aware prototypical network; Keyword masking mechanism; Adaptive word mover's distance; Knowledge distillation;
D O I
10.1007/s10489-022-03210-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As few-shot relation classification requires less data to train the neural network models, high costs related to data collection and labeling are eliminated. Compared with the traditional few-shot task, the interdisciplinary few-shot relation classification faces many semantic gap issues (e.g., common sense, subject terminology and insufficient migratable information), bringing the linguistic bias between the testing phase and the training phase. Previous methods mainly focus on the training phase itself and neglect the inherent syntactic and semantic heterogeneity in terms of gap issues. In this paper, we propose a Domain-Aware Prototypical Network (DPNet) to cast the interdisciplinary few-shot relation classification as a covariate shift task. First, the relational keyword masking mechanism, which masks the keywords with a certain probability, is adopted to learn the contextual structure information. Second, to reduce the influence of subject-specific terminology, the adaptive word mover's distance (WMD) is proposed to calculate the similarity among test samples by weighting each word in the sentence. Third, the knowledge distillation strategy integrates each category distribution characteristic into a prototypical network, which supplements additional information for metric learning in task-adaptive feature sub-space. We conduct various experiments on two widely used benchmarks (FewRel 2.0 and DDI-13 dataset). Experimental results show that our model outperforms related methods by a significant margin.
引用
收藏
页码:15718 / 15733
页数:16
相关论文
共 50 条
  • [1] DPNet: domain-aware prototypical network for interdisciplinary few-shot relation classification
    Bo Lv
    Li Jin
    Xiaoyu Li
    Xian Sun
    Zhi Guo
    Zequn Zhang
    Shuchao Li
    Applied Intelligence, 2022, 52 : 15718 - 15733
  • [2] Density-Aware Prototypical Network for Few-Shot Relation Classification
    Wu, Jianfeng
    Hu, Mengting
    Wu, Yike
    Wu, Bingzhe
    Xie, Yalan
    Liu, Mingming
    Cheng, Renhong
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 2477 - 2489
  • [3] Taxonomy-Aware Prototypical Network for Few-Shot Relation Extraction
    Wang, Mengru
    Zheng, Jianming
    Chen, Honghui
    MATHEMATICS, 2022, 10 (22)
  • [4] Prototypical attention network for few-shot relation classification with entity-aware embedding module
    Xuewei Li
    Chao Liu
    Jian Yu
    Tianyi Xu
    Mankun Zhao
    Hongwei Liu
    Mei Yu
    Ruiguo Yu
    Applied Intelligence, 2023, 53 : 10978 - 10994
  • [5] Prototypical attention network for few-shot relation classification with entity-aware embedding module
    Li, Xuewei
    Liu, Chao
    Yu, Jian
    Xu, Tianyi
    Zhao, Mankun
    Liu, Hongwei
    Yu, Mei
    Yu, Ruiguo
    APPLIED INTELLIGENCE, 2023, 53 (09) : 10978 - 10994
  • [6] TRANSDUCTIVE PROTOTYPICAL NETWORK FOR FEW-SHOT CLASSIFICATION
    Liu, Xinyue
    Liu, Pengxin
    Zong, Linlin
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1671 - 1675
  • [7] Enhance Prototypical Network with Text Descriptions for Few-shot Relation Classification
    Yang, Kaijia
    Zheng, Nantao
    Dai, Xinyu
    He, Liang
    Huang, Shujian
    Chen, Jiajun
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2273 - 2276
  • [8] Global-Aware Prototypical Network for Few-Shot Encrypted Traffic Classification
    Guo, Jingyu
    Cui, Mingxin
    Hou, Chengshang
    Gou, Gaopeng
    Li, Zhen
    Xiong, Gang
    Liu, Chang
    2022 IFIP NETWORKING CONFERENCE (IFIP NETWORKING), 2022,
  • [9] Enhanced prototypical network for few-shot relation extraction
    Wen, Wen
    Liu, Yongbin
    Ouyang, Chunping
    Lin, Qiang
    Chung, Tonglee
    INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (04)
  • [10] Multi-transformer based on prototypical enhancement network for few-shot relation classification with domain adaptation
    Du, Hongfei
    Zhang, Qinghua
    Li, Keyuan
    Zhao, Fan
    Wang, Guoyin
    NEUROCOMPUTING, 2023, 559