Document-Level Relation Extraction with Local Relation and Global Inference

被引:1
|
作者
Liu, Yiming [1 ]
Shan, Hongtao [1 ]
Nie, Feng [2 ]
Zhang, Gaoyu [3 ]
Yuan, George Xianzhi [4 ,5 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
[2] Shanghai Lixin Univ Accounting & Finance, Sch Finance, Shanghai 201209, Peoples R China
[3] Shanghai Lixin Univ Accounting & Finance, Sch Informat Management, Shanghai 201209, Peoples R China
[4] Chongqing Univ Technol, Coll Sci, Chongqing 400054, Peoples R China
[5] Chengdu Univ, Business Sch, Chengdu 610106, Peoples R China
基金
中国国家自然科学基金;
关键词
document-level relation extraction; multi-hop reasoning; attention mechanism; BERT pre-trained model; Floyd algorithm;
D O I
10.3390/info14070365
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The current popular approach to the extraction of document-level relations is mainly based on either a graph structure or serialization model method for the inference, but the graph structure method makes the model complicated, while the serialization model method decreases the extraction accuracy as the text length increases. To address such problems, the goal of this paper is to develop a new approach for document-level relationship extraction by applying a new idea through the consideration of so-called "Local Relationship and Global Inference" (in short, LRGI), which means that we first encode the text using the BERT pre-training model to obtain a local relationship vector first by considering a local context pooling and bilinear group algorithm and then establishing a global inference mechanism based on Floyd's algorithm to achieve multi-path multi-hop inference and obtain the global inference vector, which allow us to extract multi-classified relationships with adaptive thresholding criteria. Taking the DocRED dataset as a testing set, the numerical results show that our proposed new approach (LRGI) in this paper achieves an accuracy of 0.73, and the value of F1 is 62.11, corresponding to 28% and 2% improvements by comparing with the classical document-level relationship extraction model (ATLOP), respectively.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Collective prompt tuning with relation inference for document-level relation extraction
    Yuan, Changsen
    Cao, Yixin
    Huang, Heyan
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (05)
  • [2] Document-Level Event Temporal Relation Extraction on Global and Local Cues
    Li, Jing
    Xu, Sheng
    Li, Peifeng
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [3] Document-Level Event Temporal Relation Extraction on Global and Local Cues
    Li, Jing
    Xu, Sheng
    Li, Peifeng
    Proceedings of the International Joint Conference on Neural Networks, 2022, 2022-July
  • [4] Global-to-Local Neural Networks for Document-Level Relation Extraction
    Wang, Difeng
    Wei Hu
    Cao, Ermei
    Sun, Weijian
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 3711 - 3721
  • [5] Document-level relation extraction with global and path dependencies
    Jia, Wei
    Ma, Ruizhe
    Yan, Li
    Niu, Weinan
    Ma, Zongmin
    KNOWLEDGE-BASED SYSTEMS, 2024, 289
  • [6] Denoising Graph Inference Network for Document-Level Relation Extraction
    Wang, Hailin
    Qin, Ke
    Duan, Guiduo
    Luo, Guangchun
    BIG DATA MINING AND ANALYTICS, 2023, 6 (02) : 248 - 262
  • [7] Document-level Relation Extraction with Relation Correlations
    Han, Ridong
    Peng, Tao
    Wang, Benyou
    Liu, Lu
    Tiwari, Prayag
    Wan, Xiang
    NEURAL NETWORKS, 2024, 171 : 14 - 24
  • [8] HIN: Hierarchical Inference Network for Document-Level Relation Extraction
    Tang, Hengzhu
    Cao, Yanan
    Zhang, Zhenyu
    Cao, Jiangxia
    Fang, Fang
    Wang, Shi
    Yin, Pengfei
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 197 - 209
  • [9] Document-Level Relation Extraction with Reconstruction
    Xu, Wang
    Chen, Kehai
    Zhao, Tiejun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14167 - 14175
  • [10] Survey on Document-Level Relation Extraction
    Zhou Y.
    Huang H.
    Liu H.
    Hao Z.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2022, 50 (04): : 10 - 25