Enhancing relation extraction using multi-task learning with SDP evidence

被引:0
|
作者
Wang, Hailin [1 ,2 ]
Zhang, Dan [1 ,2 ]
Liu, Guisong [1 ,2 ]
Huang, Li [1 ,2 ]
Qin, Ke [3 ]
机构
[1] Southwestern Univ Finance & Econ, Sch Comp & Artificial Intelligence, Complex Lab New Finance & Econ, Chengdu 611130, Peoples R China
[2] Kash Inst Elect & Informat Ind, Kashgar, Xinjiang, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Relation extraction; Multi-task learning; Shortest dependency path; Evidence; ATTENTION; MODEL;
D O I
10.1016/j.ins.2024.120610
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Relation extraction (RE) is a crucial subtask of information extraction, which involves recognizing the relation between entity pairs in a sentence. Previous studies have extensively employed syntactic information, notably the shortest dependency path (SDP), to collect word evidence, termed SDP evidence, which gives clues about the given entity pair, thus improving RE. Nevertheless, prevalent transformer -based techniques lack syntactic information and cannot effectively model essential syntactic clues to support relations. This study exerts multi -task learning to address these issues by imbibing an SDP token position prediction task into the RE task. To this end, we introduce SGA, an SDP evidence guiding approach that transfers the SDP evidence into two novel supervisory signal labels: SDP tokens label and SDP matrix label. The former guides the attention modules to assign high attention weights to SDP token positions, emphasizing relational clues. In the meantime, the latter supervises SGA to predict a parameterized asymmetric product matrix among the SDP tokens for RE. Experimental outcomes demonstrate the model's enhanced ability to leverage SDP information, thereby directing attention modules and predicted matrix labels to focus on SDP evidence. Consequently, our proposed approach surpasses existing publicly available optimal baselines across four RE datasets: SemEval2010-Task8, KBP37, NYT, and WebNLG. 1
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Metadata-driven Task Relation Discovery for Multi-task Learning
    Zheng, Zimu
    Wang, Yuqi
    Dai, Quanyu
    Zheng, Huadi
    Wang, Dan
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 4426 - 4432
  • [22] Feature Extraction of Laser Machining Data by Using Deep Multi-Task Learning
    Zhang, Quexuan
    Wang, Zexuan
    Wang, Bin
    Ohsawa, Yukio
    Hayashi, Teruaki
    INFORMATION, 2020, 11 (08)
  • [23] The Entity Relationship Extraction Method Using Improved RoBERTa and Multi-Task Learning
    Fan, Chaoyu
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (02): : 1719 - 1738
  • [24] Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Data
    Ye, Wei
    Li, Bo
    Xie, Rui
    Sheng, Zhonghao
    Chen, Long
    Zhang, Shikun
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 1351 - 1360
  • [25] Enhancing Direction-of-Arrival Estimation with Multi-Task Learning
    Bianco, Simone
    Celona, Luigi
    Crotti, Paolo
    Napoletano, Paolo
    Petraglia, Giovanni
    Vinetti, Pietro
    SENSORS, 2024, 24 (22)
  • [26] Joint Chinese Event Extraction Based Multi-task Learning
    He R.-F.
    Duan S.-Y.
    Ruan Jian Xue Bao/Journal of Software, 2019, 30 (04): : 1015 - 1030
  • [27] Multi-task Learning Neural Networks for Comparative Elements Extraction
    Liu, Dianqing
    Wang, Lihui
    Shao, Yanqiu
    CHINESE LEXICAL SEMANTICS (CLSW 2020), 2021, 12278 : 398 - 407
  • [28] Learning Implicit and Explicit Multi-task Interactions for Information Extraction
    Sun, Kai
    Zhang, Richong
    Mensah, Samuel
    Mao, Yongyi
    Liu, Xudong
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2023, 41 (02)
  • [29] Multi-task learning for toxic comment classification and rationale extraction
    Nelatoori, Kiran Babu
    Kommanti, Hima Bindu
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2023, 60 (02) : 495 - 519
  • [30] Multi-task learning for toxic comment classification and rationale extraction
    Kiran Babu Nelatoori
    Hima Bindu Kommanti
    Journal of Intelligent Information Systems, 2023, 60 : 495 - 519