A comprehensive exploration of semantic relation extraction via pre-trained CNNs

被引:35
|
作者
Li, Qing [1 ]
Li, Lili [2 ]
Wang, Weinan [3 ]
Li, Qi [4 ]
Zhong, Jiang [1 ,5 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing, Peoples R China
[2] Chongqing Univ, Sch Civil Engn, Chongqing, Peoples R China
[3] Peking Univ, Sch Math Sci, Beijing, Peoples R China
[4] Shaoxing Univ, Dept Comp Sci & Engn, Shaoxing, Peoples R China
[5] Chongqing Univ, Key Lab Dependable Serv Comp Cyber Phys Soc, Chongqing, Peoples R China
关键词
Relation extraction; Semantic relation; Natural language processing; Convolutional neural networks;
D O I
10.1016/j.knosys.2020.105488
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semantic relation extraction between entity pairs is a crucial task in information extraction from text. In this paper, we propose a new pre-trained network architecture for this task, and it is called the XM-CNN. The XM-CNN utilizes word embedding and position embedding information. It is designed to reinforce the contextual output from the MT-DNNKD pre-trained model. Our model effectively utilized an entity-aware attention mechanisms to detected the features and also adopts and applies more relation-specific pooling attention mechanisms applied to it. The experimental results show that the XM-CNN achieves state-of-the-art results on the SemEval-2010 task 8, and a thorough evaluation of the method is conducted. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:7
相关论文
共 50 条
  • [31] ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
    Qin, Yujia
    Lin, Yankai
    Takanobu, Ryuichi
    Liu, Zhiyuan
    Li, Peng
    Ji, Heng
    Huang, Minlie
    Sun, Maosong
    Zhou, Jie
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 3350 - 3363
  • [32] Pre-Trained Semantic Embeddings for POI Categories Based on Multiple Contexts
    Bing, Junxiang
    Chen, Meng
    Yang, Min
    Huang, Weiming
    Gong, Yongshun
    Nie, Liqiang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (09) : 8893 - 8904
  • [33] Exploring Pre-trained Language Models for Event Extraction and Generation
    Yang, Sen
    Feng, Dawei
    Qiao, Linbo
    Kan, Zhigang
    Li, Dongsheng
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 5284 - 5294
  • [34] Distilling Relation Embeddings from Pre-trained Language Models
    Ushio, Asahi
    Camacho-Collados, Jose
    Schockaert, Steven
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 9044 - 9062
  • [35] Explicit Semantic Cross Feature Learning via Pre-trained Graph Neural Networks for CTR Prediction
    Li, Feng
    Yan, Bencheng
    Long, Qingqing
    Wang, Pengjie
    Lin, Wei
    Xu, Jian
    Zheng, Bo
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 2161 - 2165
  • [36] 3D Semantic Novelty Detection via Large-Scale Pre-Trained Models
    Rabino, Paolo
    Alliegro, Antonio
    Tommasi, Tatiana
    IEEE ACCESS, 2024, 12 : 135352 - 135361
  • [37] An Empirical Study of Pre-trained Transformers for Arabic Information Extraction
    Lan, Wuwei
    Chen, Yang
    Xu, Wei
    Ritter, Alan
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 4727 - 4734
  • [38] The Impact of Pre-trained Language Models on Turkish Semantic Role Labelling
    Oral, Elif
    Eryigit, Gulsen
    2022 30TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2022,
  • [39] An analysis of pre-trained stable diffusion models through a semantic lens
    Bonechi, Simone
    Andreini, Paolo
    Corradini, Barbara Toniella
    Scarselli, Franco
    NEUROCOMPUTING, 2025, 614
  • [40] Semantic Segmentation of Mammograms Using Pre-Trained Deep Neural Networks
    Prates, Rodrigo Leite
    Gomez-Flores, Wilfrido
    Pereira, Wagner
    2021 18TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, COMPUTING SCIENCE AND AUTOMATIC CONTROL (CCE 2021), 2021,