Sequence to sequence learning for joint extraction of entities and relations

被引:8
|
作者
Liang, Zeyu [1 ]
Du, Junping [2 ]
机构
[1] Commun Univ China, Sch Data Sci & Intelligent Media, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing Key Lab Intelligent Telecommun Software &, Beijing 100876, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Sequence to sequence learning; Gate graph neural networks; Joint extraction of entities and relations;
D O I
10.1016/j.neucom.2022.05.074
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The relations of two entities contained in the sentence are often complicated. There exists multiple relation tuples which owns one or both the same entities among them. Extracting those overlapped multiple relation tuples faces great challenges. Most existing works employ the famous Seq2Seq model for joint extraction of entities and relations, which cannot handle the multiple relations properly due to the missing of graph structure information of the relations and entities in a sentence. In this paper, we propose Seq2Seq-RE, an end-to-end relation extraction model, which first utilizes the gate graph neural networks (GGNNs) for joint extraction of entities and relations. Unlike previous works, we take the interaction of entities and relations through a GGNNs-based sequence-to-sequence with attention mechanism for better extracting multiple relation tuples. Besides, our graph structure based on the forward-edge, backward-edge, self-edge, and dependency-edge. To our knowledge, we are the first to employ four types of edge into graph-based neural networks for joint extraction of entities and relations and conduct a comprehensive qualitative analysis to investigate what types of edges benefit our task. Experimental results show that our model surpasses the current strong baseline methods by 1.7% in NYT29 and 0.8% in NYT24 (F1 score). (c) 2022 Published by Elsevier B.V.
引用
收藏
页码:480 / 488
页数:9
相关论文
共 50 条
  • [31] Joint Extraction of Multiple Relations and Entities by Using a Hybrid Neural Network
    Zhou, Peng
    Zheng, Suncong
    Xu, Jiaming
    Qi, Zhenyu
    Bao, Hongyun
    Xu, Bo
    CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA, CCL 2017, 2017, 10565 : 135 - 146
  • [32] TDEER: An Efficient Translating Decoding Schema for Joint Extraction of Entities and Relations
    Li, Xianming
    Luo, Xiaotian
    Dong, Chenghao
    Yang, Daichuan
    Luan, Beidi
    He, Zhen
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 8055 - 8064
  • [33] SEPC: Improving Joint Extraction of Entities and Relations by Strengthening Entity Pairs Connection
    Zhao, Jiapeng
    Zhang, Panpan
    Liu, Tingwen
    Shi, Jinqiao
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT I, 2021, 12712 : 817 - 828
  • [34] Joint extraction of entities and relations via an entity correlated attention neural model
    Li, Ren
    Li, Dong
    Yang, Jianxi
    Xiang, Fangyue
    Ren, Hao
    Jiang, Shixin
    Zhang, Luyi
    INFORMATION SCIENCES, 2021, 581 (581) : 179 - 193
  • [35] EmRel: Joint Representation of Entities and Embedded Relations for Multi-triple Extraction
    Xu, Benfeng
    Wang, Quan
    Lyu, Yajuan
    Shi, Yabing
    Zhu, Yong
    Gao, Jie
    Mao, Zhendong
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 659 - 665
  • [36] Joint extraction of entities and relations in biomedical text with self--attention mechanism
    Chen, Jizhi
    Gu, Junzhong
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 125 : 3 - 3
  • [37] Legal Party Extraction from Legal Opinion Text with Sequence to Sequence Learning
    de Almeida, Melonie
    Samarawickrama, Chamodi
    de Silva, Nisansa
    Ratnayaka, Gathika
    Perera, Amal Shehan
    2020 20TH INTERNATIONAL CONFERENCE ON ADVANCES IN ICT FOR EMERGING REGIONS (ICTER-2020), 2020, : 143 - 148
  • [38] A Survey on Deep Learning Techniques for Joint Named Entities and Relation Extraction
    Kambar, Mina Esmail Zadeh Nojoo
    Esmaeilzadeh, Armin
    Heidari, Maryam
    2022 IEEE WORLD AI IOT CONGRESS (AIIOT), 2022, : 218 - 224
  • [39] Joint Extraction of Entities and Relations via Entity and Relation Heterogeneous Graph Attention Networks
    Jiang, Bo
    Cao, Jia
    APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [40] Joint extraction of entities and relations using multi-label tagging and relational alignment
    Hang, Tingting
    Feng, Jun
    Yan, Le
    Wang, Yunfeng
    Lu, Jiamin
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (08): : 6397 - 6412