Document-Level Relation Extraction with Local Relation and Global Inference

被引:1
|
作者
Liu, Yiming [1 ]
Shan, Hongtao [1 ]
Nie, Feng [2 ]
Zhang, Gaoyu [3 ]
Yuan, George Xianzhi [4 ,5 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
[2] Shanghai Lixin Univ Accounting & Finance, Sch Finance, Shanghai 201209, Peoples R China
[3] Shanghai Lixin Univ Accounting & Finance, Sch Informat Management, Shanghai 201209, Peoples R China
[4] Chongqing Univ Technol, Coll Sci, Chongqing 400054, Peoples R China
[5] Chengdu Univ, Business Sch, Chengdu 610106, Peoples R China
基金
中国国家自然科学基金;
关键词
document-level relation extraction; multi-hop reasoning; attention mechanism; BERT pre-trained model; Floyd algorithm;
D O I
10.3390/info14070365
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The current popular approach to the extraction of document-level relations is mainly based on either a graph structure or serialization model method for the inference, but the graph structure method makes the model complicated, while the serialization model method decreases the extraction accuracy as the text length increases. To address such problems, the goal of this paper is to develop a new approach for document-level relationship extraction by applying a new idea through the consideration of so-called "Local Relationship and Global Inference" (in short, LRGI), which means that we first encode the text using the BERT pre-training model to obtain a local relationship vector first by considering a local context pooling and bilinear group algorithm and then establishing a global inference mechanism based on Floyd's algorithm to achieve multi-path multi-hop inference and obtain the global inference vector, which allow us to extract multi-classified relationships with adaptive thresholding criteria. Taking the DocRED dataset as a testing set, the numerical results show that our proposed new approach (LRGI) in this paper achieves an accuracy of 0.73, and the value of F1 is 62.11, corresponding to 28% and 2% improvements by comparing with the classical document-level relationship extraction model (ATLOP), respectively.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] TDGI: Translation-Guided Double-Graph Inference for Document-Level Relation Extraction
    Zhang, Lingling
    Zhong, Yujie
    Zheng, Qinghua
    Liu, Jun
    Wang, Qianying
    Wang, Jiaxin
    Chang, Xiaojun
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (04) : 2647 - 2659
  • [42] Improving inference via rich path information and logic rules for document-level relation extraction
    Su, Huizhe
    Xie, Shaorong
    Yu, Hang
    Yuan, Changsen
    Wang, Xinzhi
    Luo, Xiangfeng
    KNOWLEDGE AND INFORMATION SYSTEMS, 2025, : 4207 - 4231
  • [43] Evidence Reasoning and Curriculum Learning for Document-Level Relation Extraction
    Xu, Tianyu
    Qu, Jianfeng
    Hua, Wen
    Li, Zhixu
    Xu, Jiajie
    Liu, An
    Zhao, Lei
    Zhou, Xiaofang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (02) : 594 - 607
  • [44] Double Graph Based Reasoning for Document-level Relation Extraction
    Zeng, Shuang
    Xu, Runxin
    Chang, Baobao
    Li, Lei
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 1630 - 1640
  • [45] Document-Level Relation Extraction with Entity Enhancement and Context Refinement
    Zou, Meng
    Yang, Qiang
    Qu, Jianfeng
    Li, Zhixu
    Liu, An
    Zhao, Lei
    Chen, Zhigang
    WEB INFORMATION SYSTEMS ENGINEERING - WISE 2021, PT II, 2021, 13081 : 347 - 362
  • [46] A Personalized Federated Framework for Document-level Biomedical Relation Extraction
    Xiao, Yan
    Jin, Yaochu
    Zhang, Haoyu
    Huo, Xu
    Liu, Qiqi
    Zheng, Zeqi
    2024 6TH INTERNATIONAL CONFERENCE ON DATA-DRIVEN OPTIMIZATION OF COMPLEX SYSTEMS, DOCS 2024, 2024, : 457 - 461
  • [47] Enhancing Document-Level Relation Extraction by Entity Knowledge Injection
    Wang, Xinyi
    Wang, Zitao
    Sun, Weijian
    Hu, Wei
    SEMANTIC WEB - ISWC 2022, 2022, 13489 : 39 - 56
  • [48] Modular Self-Supervision for Document-Level Relation Extraction
    Zhang, Sheng
    Wong, Cliff
    Usuyama, Naoto
    Jain, Sarthak
    Naumann, Tristan
    Poon, Hoifung
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 5291 - 5302
  • [49] Towards Integration of Discriminability and Robustness for Document-Level Relation Extraction
    Guo, Jia
    Kok, Stanley
    Bing, Lidong
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 2606 - 2617
  • [50] CorefDRE: Coref-Aware Document-Level Relation Extraction
    Xue, Zhongxuan
    Zhong, Jiang
    Dai, Qizhu
    Li, Rongzhen
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2022, PT III, 2022, 13370 : 116 - 128