Enhancing relation extraction using multi-task learning with SDP evidence

被引:0
|
作者
Wang, Hailin [1 ,2 ]
Zhang, Dan [1 ,2 ]
Liu, Guisong [1 ,2 ]
Huang, Li [1 ,2 ]
Qin, Ke [3 ]
机构
[1] Southwestern Univ Finance & Econ, Sch Comp & Artificial Intelligence, Complex Lab New Finance & Econ, Chengdu 611130, Peoples R China
[2] Kash Inst Elect & Informat Ind, Kashgar, Xinjiang, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Relation extraction; Multi-task learning; Shortest dependency path; Evidence; ATTENTION; MODEL;
D O I
10.1016/j.ins.2024.120610
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Relation extraction (RE) is a crucial subtask of information extraction, which involves recognizing the relation between entity pairs in a sentence. Previous studies have extensively employed syntactic information, notably the shortest dependency path (SDP), to collect word evidence, termed SDP evidence, which gives clues about the given entity pair, thus improving RE. Nevertheless, prevalent transformer -based techniques lack syntactic information and cannot effectively model essential syntactic clues to support relations. This study exerts multi -task learning to address these issues by imbibing an SDP token position prediction task into the RE task. To this end, we introduce SGA, an SDP evidence guiding approach that transfers the SDP evidence into two novel supervisory signal labels: SDP tokens label and SDP matrix label. The former guides the attention modules to assign high attention weights to SDP token positions, emphasizing relational clues. In the meantime, the latter supervises SGA to predict a parameterized asymmetric product matrix among the SDP tokens for RE. Experimental outcomes demonstrate the model's enhanced ability to leverage SDP information, thereby directing attention modules and predicted matrix labels to focus on SDP evidence. Consequently, our proposed approach surpasses existing publicly available optimal baselines across four RE datasets: SemEval2010-Task8, KBP37, NYT, and WebNLG. 1
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Enhancing Relation Extraction via Adversarial Multi-task Learning
    Qin, Han
    Tian, Yuanhe
    Song, Yan
    LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2022, : 6190 - 6199
  • [2] Multi-Task Learning for Relation Extraction
    Zhou, Kai
    Luo, Xiangfeng
    Wang, Hao
    Xu, Richard
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1480 - 1487
  • [3] Continual Relation Extraction via Sequential Multi-Task Learning
    Thanh-Thien Le
    Manh Nguyen
    Tung Thanh Nguyen
    Linh Ngo Van
    Thien Huu Nguyen
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 18444 - 18452
  • [4] Integration of Relation Filtering and Multi-Task Learning in GlobalPointer for Entity and Relation Extraction
    Liu, Bin
    Tao, Jialin
    Chen, Wanyuan
    Zhang, Yijie
    Chen, Min
    He, Lei
    Tang, Dan
    APPLIED SCIENCES-BASEL, 2024, 14 (15):
  • [5] Multi-task learning for few-shot biomedical relation extraction
    Moscato, Vincenzo
    Napolano, Giuseppe
    Postiglione, Marco
    Sperli, Giancarlo
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (11) : 13743 - 13763
  • [6] Fine-grained relation extraction with focal multi-task learning
    Zhang, Xinsong
    Liu, Tianyi
    Jia, Weijia
    Li, Pengshuai
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (06)
  • [7] Fine-grained relation extraction with focal multi-task learning
    Xinsong Zhang
    Tianyi Liu
    Weijia Jia
    Pengshuai Li
    Science China Information Sciences, 2020, 63
  • [8] A multi-task learning based approach to biomedical entity relation extraction
    Li, Qingqing
    Yang, Zhihao
    Luo, Ling
    Wang, Lei
    Zhang, Yin
    Lin, Hongfei
    Wang, Jian
    Yang, Liang
    Xu, Kan
    Zhang, Yijia
    PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 680 - 682
  • [9] Fine-grained relation extraction with focal multi-task learning
    Xinsong ZHANG
    Tianyi LIU
    Weijia JIA
    Pengshuai LI
    ScienceChina(InformationSciences), 2020, 63 (06) : 229 - 231
  • [10] Multi-task learning for few-shot biomedical relation extraction
    Vincenzo Moscato
    Giuseppe Napolano
    Marco Postiglione
    Giancarlo Sperlì
    Artificial Intelligence Review, 2023, 56 : 13743 - 13763