Integration of Relation Filtering and Multi-Task Learning in GlobalPointer for Entity and Relation Extraction

被引:0
|
作者
Liu, Bin [1 ,2 ]
Tao, Jialin [1 ,2 ]
Chen, Wanyuan [1 ,2 ]
Zhang, Yijie [1 ,2 ]
Chen, Min [1 ,2 ]
He, Lei [1 ,2 ]
Tang, Dan [1 ,2 ]
机构
[1] Chengdu Univ Informat Technol, Sch Software Engn, Chengdu 610225, Peoples R China
[2] Sichuan Prov Engn Technol Res Ctr Support Software, Chengdu 610225, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 15期
关键词
knowledge graph; joint entity and relation extraction; overlapping triplets; multi-task learning;
D O I
10.3390/app14156832
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The rise of knowledge graphs has been instrumental in advancing artificial intelligence (AI) research. Extracting entity and relation triples from unstructured text is crucial for the construction of knowledge graphs. However, Chinese text has a complex grammatical structure, which may lead to the problem of overlapping entities. Previous pipeline models have struggled to address such overlap problems effectively, while joint models require entity annotations for each predefined relation in the set, which results in redundant relations. In addition, the traditional models often lead to task imbalance by overlooking the differences between tasks. To tackle these challenges, this research proposes a global pointer network based on relation prediction and loss function improvement (GPRL) for joint extraction of entities and relations. Experimental evaluations on the publicly available Chinese datasets DuIE2.0 and CMeIE demonstrate that the GPRL model achieves a 1.2-26.1% improvement in F1 score compared with baseline models. Further, experiments of overlapping classification conducted on CMeIE have also verified the effectiveness of overlapping triad extraction and ablation experiments. The model is helpful in identifying entities and relations accurately and can reduce redundancy by leveraging relation filtering and the global pointer network. In addition, the incorporation of a multi-task learning framework balances the loss functions of multiple tasks and enhances task interactions.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] A neural network framework for relation extraction: Learning entity semantic and relation pattern
    Zheng, Suncong
    Xu, Jiaming
    Zhou, Peng
    Bao, Hongyun
    Qi, Zhenyu
    Xu, Bo
    KNOWLEDGE-BASED SYSTEMS, 2016, 114 : 12 - 23
  • [32] RAHM: Relation augmented hierarchical multi-task learning framework for reasonable medication stocking
    An, Yang
    Mao, Yakun
    Zhang, Liang
    Jin, Bo
    Xiao, Keli
    Wei, Xiaopeng
    Yan, Jun
    JOURNAL OF BIOMEDICAL INFORMATICS, 2020, 108
  • [33] A simple but effective model for attachment in discourse parsing with multi-task learning for relation labeling
    Bennis, Zineb
    Hunter, Julie
    Asher, Nicholas
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 3412 - 3417
  • [34] Bootstrapping Joint Entity and Relation Extraction with Reinforcement Learning
    Xia, Min
    Cheng, Xiang
    Su, Sen
    Kuang, Ming
    Li, Gang
    WEB INFORMATION SYSTEMS ENGINEERING - WISE 2022, 2022, 13724 : 418 - 432
  • [35] Joint Entity and Relation Extraction Based on Reinforcement Learning
    Zhou, Xin
    Liu, Luping
    Luo, Xiaodong
    Chen, Haiqiang
    Qing, Linbo
    He, Xiaohai
    IEEE ACCESS, 2019, 7 : 125688 - 125699
  • [36] Automatically learning linguistic structures for entity relation extraction
    Yang, Weizhe
    Chen, Yanping
    Xu, Jinling
    Qin, Yongbin
    Chen, Ping
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (01)
  • [37] Joint Learning of Named Entity Recognition and Relation Extraction
    Xu, Qiuyan
    Li, Fang
    2011 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), VOLS 1-4, 2012, : 1978 - 1982
  • [38] A New Approach of Automatic Entity Relation Extraction Combined Multi-machine Learning
    Zhang Suxiang
    Zhang Suxian
    ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 1570 - +
  • [39] Research on multi-feature fusion entity relation extraction based on deep learning
    Xu, Shiao
    Sun, Shuihua
    Zhang, Zhiyuan
    Xu, Fan
    INTERNATIONAL JOURNAL OF AD HOC AND UBIQUITOUS COMPUTING, 2022, 39 (1-2) : 93 - 104
  • [40] A Multi-task Learning Framework for Opinion Triplet Extraction
    Zhang, Chen
    Li, Qiuchi
    Song, Dawei
    Wang, Benyou
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 819 - 828