Integration of Relation Filtering and Multi-Task Learning in GlobalPointer for Entity and Relation Extraction

被引:0
|
作者
Liu, Bin [1 ,2 ]
Tao, Jialin [1 ,2 ]
Chen, Wanyuan [1 ,2 ]
Zhang, Yijie [1 ,2 ]
Chen, Min [1 ,2 ]
He, Lei [1 ,2 ]
Tang, Dan [1 ,2 ]
机构
[1] Chengdu Univ Informat Technol, Sch Software Engn, Chengdu 610225, Peoples R China
[2] Sichuan Prov Engn Technol Res Ctr Support Software, Chengdu 610225, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 15期
关键词
knowledge graph; joint entity and relation extraction; overlapping triplets; multi-task learning;
D O I
10.3390/app14156832
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The rise of knowledge graphs has been instrumental in advancing artificial intelligence (AI) research. Extracting entity and relation triples from unstructured text is crucial for the construction of knowledge graphs. However, Chinese text has a complex grammatical structure, which may lead to the problem of overlapping entities. Previous pipeline models have struggled to address such overlap problems effectively, while joint models require entity annotations for each predefined relation in the set, which results in redundant relations. In addition, the traditional models often lead to task imbalance by overlooking the differences between tasks. To tackle these challenges, this research proposes a global pointer network based on relation prediction and loss function improvement (GPRL) for joint extraction of entities and relations. Experimental evaluations on the publicly available Chinese datasets DuIE2.0 and CMeIE demonstrate that the GPRL model achieves a 1.2-26.1% improvement in F1 score compared with baseline models. Further, experiments of overlapping classification conducted on CMeIE have also verified the effectiveness of overlapping triad extraction and ablation experiments. The model is helpful in identifying entities and relations accurately and can reduce redundancy by leveraging relation filtering and the global pointer network. In addition, the incorporation of a multi-task learning framework balances the loss functions of multiple tasks and enhances task interactions.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] A multi-task learning based approach to biomedical entity relation extraction
    Li, Qingqing
    Yang, Zhihao
    Luo, Ling
    Wang, Lei
    Zhang, Yin
    Lin, Hongfei
    Wang, Jian
    Yang, Liang
    Xu, Kan
    Zhang, Yijia
    PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 680 - 682
  • [2] Multi-Task Learning for Relation Extraction
    Zhou, Kai
    Luo, Xiangfeng
    Wang, Hao
    Xu, Richard
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1480 - 1487
  • [3] REET: Joint Relation Extraction and Entity Typing via Multi-task Learning
    Liu, Hongtao
    Wang, Peiyi
    Wu, Fangzhao
    Jiao, Pengfei
    Wang, Wenjun
    Xie, Xing
    Sun, Yueheng
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 327 - 339
  • [4] Joint Entity and Relation Extraction for Multi-Crime Legal Documents with Multi-Task Learning
    Wang, Zhuoyue
    Chen, Yanguang
    Xing, Tiejun
    Sun, Yuanyuan
    Yang, Liang
    Lin, Hongfei
    Computer Engineering and Applications, 2024, 59 (02) : 178 - 184
  • [5] Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Data
    Ye, Wei
    Li, Bo
    Xie, Rui
    Sheng, Zhonghao
    Chen, Long
    Zhang, Shikun
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 1351 - 1360
  • [6] Enhancing Relation Extraction via Adversarial Multi-task Learning
    Qin, Han
    Tian, Yuanhe
    Song, Yan
    LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2022, : 6190 - 6199
  • [7] Continual Relation Extraction via Sequential Multi-Task Learning
    Thanh-Thien Le
    Manh Nguyen
    Tung Thanh Nguyen
    Linh Ngo Van
    Thien Huu Nguyen
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 18444 - 18452
  • [8] Multi-task learning for few-shot biomedical relation extraction
    Moscato, Vincenzo
    Napolano, Giuseppe
    Postiglione, Marco
    Sperli, Giancarlo
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (11) : 13743 - 13763
  • [9] Fine-grained relation extraction with focal multi-task learning
    Zhang, Xinsong
    Liu, Tianyi
    Jia, Weijia
    Li, Pengshuai
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (06)
  • [10] Fine-grained relation extraction with focal multi-task learning
    Xinsong Zhang
    Tianyi Liu
    Weijia Jia
    Pengshuai Li
    Science China Information Sciences, 2020, 63