Document-Level Relation Extraction with Local Relation and Global Inference

被引:1
|
作者
Liu, Yiming [1 ]
Shan, Hongtao [1 ]
Nie, Feng [2 ]
Zhang, Gaoyu [3 ]
Yuan, George Xianzhi [4 ,5 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
[2] Shanghai Lixin Univ Accounting & Finance, Sch Finance, Shanghai 201209, Peoples R China
[3] Shanghai Lixin Univ Accounting & Finance, Sch Informat Management, Shanghai 201209, Peoples R China
[4] Chongqing Univ Technol, Coll Sci, Chongqing 400054, Peoples R China
[5] Chengdu Univ, Business Sch, Chengdu 610106, Peoples R China
基金
中国国家自然科学基金;
关键词
document-level relation extraction; multi-hop reasoning; attention mechanism; BERT pre-trained model; Floyd algorithm;
D O I
10.3390/info14070365
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The current popular approach to the extraction of document-level relations is mainly based on either a graph structure or serialization model method for the inference, but the graph structure method makes the model complicated, while the serialization model method decreases the extraction accuracy as the text length increases. To address such problems, the goal of this paper is to develop a new approach for document-level relationship extraction by applying a new idea through the consideration of so-called "Local Relationship and Global Inference" (in short, LRGI), which means that we first encode the text using the BERT pre-training model to obtain a local relationship vector first by considering a local context pooling and bilinear group algorithm and then establishing a global inference mechanism based on Floyd's algorithm to achieve multi-path multi-hop inference and obtain the global inference vector, which allow us to extract multi-classified relationships with adaptive thresholding criteria. Taking the DocRED dataset as a testing set, the numerical results show that our proposed new approach (LRGI) in this paper achieves an accuracy of 0.73, and the value of F1 is 62.11, corresponding to 28% and 2% improvements by comparing with the classical document-level relationship extraction model (ATLOP), respectively.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] CLGR-Net: a collaborative local-global reasoning network for document-level relation extraction
    Xiaoyao Ding
    Gang Zhou
    Jicang Lu
    Taojie Zhu
    The Journal of Supercomputing, 2023, 79 : 5469 - 5485
  • [22] CLGR-Net: a collaborative local-global reasoning network for document-level relation extraction
    Ding, Xiaoyao
    Zhou, Gang
    Lu, Jicang
    Zhu, Taojie
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (05): : 5469 - 5485
  • [23] Inter span learning for document-level relation extraction
    Liao, Tao
    Sun, Haojie
    Zhang, Shunxiang
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 9965 - 9977
  • [24] Entity and Evidence Guided Document-Level Relation Extraction
    Huang, Kevin
    Qi, Peng
    Wang, Guangtao
    Ma, Tengyu
    Huang, Jing
    REPL4NLP 2021: PROCEEDINGS OF THE 6TH WORKSHOP ON REPRESENTATION LEARNING FOR NLP, 2021, : 307 - 315
  • [25] Exploiting Ubiquitous Mentions for Document-Level Relation Extraction
    Zhang, Ruoyu
    Li, Yanzeng
    Zhang, Minhao
    Zou, Lei
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 1986 - 1990
  • [26] Automatic Graph Generation for Document-Level Relation Extraction
    Yu, Yanhua
    Shen, Fangting
    Yang, Shengli
    Li, Jie
    Wang, Yuling
    Ma, Ang
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [27] Few-Shot Document-Level Relation Extraction
    Popovic, Nicholas
    Faerber, Michael
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 5733 - 5746
  • [28] Learning Logic Rules for Document-level Relation Extraction
    Ru, Dongyu
    Sun, Changzhi
    Feng, Jiangtao
    Qiu, Lin
    Zhou, Hao
    Zhang, Weinan
    Yu, Yong
    Li, Lei
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 1239 - 1250
  • [29] Document-level Relation Extraction With Entity and Context Information
    Huang, He-Yan
    Yuan, Chang-Sen
    Feng, Chong
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (10): : 1953 - 1962
  • [30] HistRED: A Historical Document-Level Relation Extraction Dataset
    Yang, Soyoung
    Choi, Minseok
    Cho, Youngwoo
    Choo, Jaegul
    arXiv, 2023,