Weighted-Dependency with Attention-Based Graph Convolutional Network for Relation Extraction

被引:2
|
作者
Dong, Yihao [1 ]
Xu, Xiaolong [2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Big Data Secur & Intelligent Proc, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Sch Comp Sci, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Relation extraction; Dependency tree; Graph convolution network; Deep learning;
D O I
10.1007/s11063-023-11412-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the complexity of natural language, the current relation extraction methods can no longer meet people's requirements. Dependency trees have been proved to be able to capture the long-distance relation between the target entity pairs, this study mainly focuses on how to prune the dependency tree more effectively, and improve the model's performance by retaining the original dependency structure of the sentence and dependency relation weighting without man-made noise. We propose a new weighted-dependency with attention-based graph convolutional network (WAGCN), which changed the dependency matrix from a 0-1 matrix to a weighted matrix by weighting each dependency class to enable the dependency matrix to fully express the syntactic dependency information in the sentence. Moreover, we improve the connection structure of the attention mechanism, densely connected network and GCN to extract important information by applying the attention mechanism directly to the text, and compute it in parallel with the dependency matrix GCN module. We conducted experiments on three popular datasets, WAGCN is superior to baseline models, such as C-AGGCN and LST-AGCN, in most experiment metrics.
引用
收藏
页码:12121 / 12142
页数:22
相关论文
共 50 条
  • [31] Attention-Based Generative Graph Convolutional Network for Skeleton-Based Human Action Recognition
    Yang, Kai
    Ding, Xiaolu
    Chen, Wai
    ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 1 - 6
  • [32] Attention-based cross-frequency graph convolutional network for driver fatigue estimation
    An, Jianpeng
    Cai, Qing
    Sun, Xinlin
    Li, Mengyu
    Ma, Chao
    Gao, Zhongke
    COGNITIVE NEURODYNAMICS, 2024, 18 (05) : 3181 - 3194
  • [33] Prediction of gas concentration evolution with evolutionary attention-based temporal graph convolutional network
    Cheng, Lei
    Li, Li
    Li, Sai
    Ran, Shaolin
    Zhang, Ze
    Zhang, Yong
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
  • [34] Attention-based generative graph convolutional network for skeleton-based human action recognition
    Yang, Kai
    Ding, Xiaolu
    Chen, Wai
    ACM International Conference Proceeding Series, 2019, : 1 - 6
  • [35] TUCNet: A channel and spatial attention-based graph convolutional network for teeth upsampling and completion
    Liu, Mengting
    Li, Xiaojie
    Liu, Jie
    Liu, Weifan
    Yu, Zekuan
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 166
  • [36] Relation extraction based on semantic dependency graph
    Jiang, Ming
    He, Jiecheng
    Wu, Jianping
    Qi, Chengjie
    Zhang, Min
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2020, 20 (01) : 279 - 290
  • [37] Dependency-driven Relation Extraction with Attentive Graph Convolutional Networks
    Tian, Yuanhe
    Chen, Guimin
    Song, Yan
    Wan, Xiang
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 4458 - 4471
  • [38] Dual Attention Guided Graph Convolutional Networks for Relation Extraction
    Li Z.-X.
    Sun Y.-R.
    Tang S.-Q.
    Zhang C.-L.
    Ma H.-F.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2021, 49 (02): : 315 - 323
  • [39] Adaptive Graph Convolutional Networks with Attention Mechanism for Relation Extraction
    Li, Zhixin
    Sun, Yaru
    Tang, Suqin
    Zhang, Canlong
    Ma, Huifang
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [40] Attention-Based Belief or Disbelief Feature Extraction for Dependency Parsing
    Peng, Haoyuan
    Liu, Lu
    Zhou, Yi
    Zhou, Junying
    Zheng, Xiaoqing
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5382 - 5389