Integration of Relation Filtering and Multi-Task Learning in GlobalPointer for Entity and Relation Extraction

被引:0
|
作者
Liu, Bin [1 ,2 ]
Tao, Jialin [1 ,2 ]
Chen, Wanyuan [1 ,2 ]
Zhang, Yijie [1 ,2 ]
Chen, Min [1 ,2 ]
He, Lei [1 ,2 ]
Tang, Dan [1 ,2 ]
机构
[1] Chengdu Univ Informat Technol, Sch Software Engn, Chengdu 610225, Peoples R China
[2] Sichuan Prov Engn Technol Res Ctr Support Software, Chengdu 610225, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 15期
关键词
knowledge graph; joint entity and relation extraction; overlapping triplets; multi-task learning;
D O I
10.3390/app14156832
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The rise of knowledge graphs has been instrumental in advancing artificial intelligence (AI) research. Extracting entity and relation triples from unstructured text is crucial for the construction of knowledge graphs. However, Chinese text has a complex grammatical structure, which may lead to the problem of overlapping entities. Previous pipeline models have struggled to address such overlap problems effectively, while joint models require entity annotations for each predefined relation in the set, which results in redundant relations. In addition, the traditional models often lead to task imbalance by overlooking the differences between tasks. To tackle these challenges, this research proposes a global pointer network based on relation prediction and loss function improvement (GPRL) for joint extraction of entities and relations. Experimental evaluations on the publicly available Chinese datasets DuIE2.0 and CMeIE demonstrate that the GPRL model achieves a 1.2-26.1% improvement in F1 score compared with baseline models. Further, experiments of overlapping classification conducted on CMeIE have also verified the effectiveness of overlapping triad extraction and ablation experiments. The model is helpful in identifying entities and relations accurately and can reduce redundancy by leveraging relation filtering and the global pointer network. In addition, the incorporation of a multi-task learning framework balances the loss functions of multiple tasks and enhances task interactions.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Multi-task and multi-view training for end-to-end relation extraction
    Zhang, Junchi
    Zhang, Yue
    Ji, Donghong
    Liu, Mengchi
    NEUROCOMPUTING, 2019, 364 : 245 - 253
  • [22] Incorporating Relation Knowledge into Commonsense Reading Comprehension with Multi-task Learning
    Xia, Jiangnan
    Wu, Chen
    Yan, Ming
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 2393 - 2396
  • [23] Hierarchical multi-task learning with CRF for implicit discourse relation recognition
    Wu, Changxing
    Hu, Chaowen
    Li, Ruochen
    Lin, Hongyu
    Su, Jinsong
    KNOWLEDGE-BASED SYSTEMS, 2020, 195
  • [24] Chain Entity Relation Extraction Model with Filtering Mechanism
    Xia H.
    Shen J.
    Liu Y.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (07): : 590 - 601
  • [25] MULTI-ENTITY COLLABORATIVE RELATION EXTRACTION
    Liu, Haozhuang
    Li, Ziran
    Sheng, Dongming
    Zheng, Hai-Tao
    Shen, Ying
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7678 - 7682
  • [26] Prototype Feature Extraction for Multi-task Learning
    Xin, Shen
    Jiao, Yuhang
    Long, Cheng
    Wang, Yuguang
    Wang, Xiaowei
    Yang, Sen
    Liu, Ji
    Zhang, Jie
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2472 - 2481
  • [27] Leveraging Multi-task Learning for Biomedical Named Entity Recognition
    Mehmood, Tahir
    Gerevini, Alfonso
    Lavelli, Alberto
    Serina, Ivan
    ADVANCES IN ARTIFICIAL INTELLIGENCE, AI*IA 2019, 2019, 11946 : 431 - 444
  • [28] Improving Entity Recommendation with Search Log and Multi-Task Learning
    Huang, Jizhou
    Zhang, Wei
    Sun, Yaming
    Wang, Haifeng
    Liu, Ting
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 4107 - 4114
  • [29] Emerging Relation Network and Task Embedding for Multi-Task Regression Problems
    Schreiber, Jens
    Sick, Bernhard
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2663 - 2670
  • [30] Biomedical Named Entity Recognition Based on Multi-task Learning
    Zhao, Hui
    Zhao, Di
    Meng, Jiana
    Su, Wen
    Mu, Wenxuan
    HEALTH INFORMATION PROCESSING, CHIP 2023, 2023, 1993 : 51 - 65