Entity Relationship Extraction Based on Bi-LSTM and Attention Mechanism

被引:5
|
作者
Wei, Ming [1 ]
Xu, Zhipeng [2 ]
Hu, Jiwei [1 ]
机构
[1] Wuhan Fiberhome Tech Serv Co Ltd, Wuhan, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Comp Sci, Wuhan, Peoples R China
关键词
Relation extraction; attention mechanism; shortest dependency path; feature fusion;
D O I
10.1145/3469213.3470701
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The extraction methods based on deep learning can automatically learn sentence features without complex feature engineering. But most current methods ignore the mining of text semantics. Therefore, based on the existing research, considering that Bi-LSTM can capture the advantages of bidirectional semantic dependence and the attention mechanism can assign different weights to the semantic features of different functions, this paper combines the two to perform entity relationship extraction. Beside, in the feature extraction layer, four types of features, part-of-speech, entity recognition type, relative position and the context of entities are introduced. In order to obtain the main connection between entities, the shortest dependency path is also introduced.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] An attention mechanism and multi-granularity-based Bi-LSTM model for Chinese Q&A system
    Xiao-mei Yu
    Wen-zhi Feng
    Hong Wang
    Qian Chu
    Qi Chen
    Soft Computing, 2020, 24 : 5831 - 5845
  • [32] Sentiment Analysis with An Integrated Model of BERT and Bi-LSTM Based on Multi-Head Attention Mechanism
    Wang, Yahui
    Cheng, Xiaoqing
    Meng, Xuelei
    IAENG International Journal of Computer Science, 2023, 50 (01)
  • [33] Power quality disturbance signal segmentation and classification based on modified BI-LSTM with double attention mechanism
    Khetarpal, Poras
    Nagpal, Neelu
    Siano, Pierluigi
    Al-Numay, Mohammed
    IET GENERATION TRANSMISSION & DISTRIBUTION, 2024, 18 (01) : 50 - 62
  • [34] REMAINING USEFUL LIFE PREDICTION OF AIRCRAFT ENGINE BASED ON BI-LSTM NETWORK INTEGRATED WITH ATTENTION MECHANISM
    Qu, Guixian
    Qiu, Tian
    Ding, Shuiting
    Ma, Long
    Yuan, Qiyu
    Ma, Qinglin
    Si, Yang
    PROCEEDINGS OF ASME TURBO EXPO 2024: TURBOMACHINERY TECHNICAL CONFERENCE AND EXPOSITION, GT2024, VOL 1, 2024,
  • [35] MSAM: A Multi-Layer Bi-LSTM Based Speech to Vector Model with Residual Attention Mechanism
    Cui, Dongdong
    Yin, Shouyi
    Gu, Jiangyuan
    Liu, Leibo
    Wei, Shaojun
    2019 IEEE INTERNATIONAL CONFERENCE ON ELECTRON DEVICES AND SOLID-STATE CIRCUITS (EDSSC), 2019,
  • [36] Sandstorm Detection Using Attention Bi-LSTM UNet
    Mahmoud, Amira S.
    El-Morshedy, Rasha M.
    Metwalli, Mohamed R.
    Mostafa, Marwa S.
    JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2024, : 1065 - 1076
  • [37] Mining Aspects in Online Comments with Attention and Bi-LSTM
    Yao, Lan
    Rong, Heting
    Chu, Chao
    Gao, Fuxiang
    5TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM 2019), 2019, : 288 - 292
  • [38] Event Detection from Web Data in Chinese Based on Bi-LSTM with Attention
    Wu, Yuxin
    Xu, Zenghui
    Li, Hongzhou
    Gan, Yuquan
    Ying, Josh Jia-Ching
    Yu, Ting
    Zhang, Ji
    ADVANCED DATA MINING AND APPLICATIONS (ADMA 2022), PT I, 2022, 13725 : 93 - 105
  • [39] Deep attention based optimized Bi-LSTM for improving geospatial data ontology
    Sambandam, Palaniappan
    Yuvaraj, D.
    Padmakumari, P.
    Swaminathan, Subbiah
    DATA & KNOWLEDGE ENGINEERING, 2023, 144
  • [40] Attention-based Bi-LSTM Model for Anomalous HTTP Traffic Detection
    Yu, Yuqi
    Liu, Guannan
    Yan, Hanbing
    Li, Hong
    Guan, Hongchao
    2018 15TH INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT (ICSSSM), 2018,