Adversarial training for supervised relation extraction

被引:4
|
作者
Yu, Yanhua [1 ]
He, Kanghao [1 ]
Li, Jie [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Natl Pilot Software Engn Sch, Sch Comp Sci, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
relation extraction; piecewise convolution neural network; adversarial training; generative adversarial network; ATTENTION;
D O I
10.26599/TST.2020.9010059
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most supervised methods for relation extraction (RE) involve time-consuming human annotation. Distant supervision for RE is an efficient method to obtain large corpora that contains thousands of instances and various relations. However, the existing approaches rely heavily on knowledge bases (e.g., Freebase), thereby introducing data noise. Various relations and noisy labeling instances make the issue difficult to solve. In this study, we propose a model based on a piecewise convolution neural network with adversarial training. Inspired by generative adversarial networks, we adopt a heuristic algorithm to identify noisy datasets and apply adversarial training to RE. Experiments on the extended dataset of SemEval-2010 Task 8 show that our model can obtain more accurate training data for RE and significantly outperforms several competitive baseline models. Our model has an Fi score of 89.61%.
引用
收藏
页码:610 / 618
页数:9
相关论文
共 50 条
  • [21] Supervised contrastive learning for robust text adversarial training
    Weidong Li
    Bo Zhao
    Yang An
    Chenhan Shangguan
    Minzi Ji
    Anqi Yuan
    Neural Computing and Applications, 2023, 35 : 7357 - 7368
  • [22] MarginGAN: Adversarial Training in Semi-Supervised Learning
    Dong, Jinhao
    Lin, Tong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [23] Generative Adversarial Training forWeakly Supervised Cloud Matting
    Zou, Zhengxia
    Li, Wenyuan
    Shi, Tianyang
    Shi, Zhenwei
    Ye, Jieping
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 201 - 210
  • [24] Supervised contrastive learning for robust text adversarial training
    Li, Weidong
    Zhao, Bo
    An, Yang
    Shangguan, Chenhan
    Ji, Minzi
    Yuan, Anqi
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (10): : 7357 - 7368
  • [25] Latent Space Virtual Adversarial Training for Supervised and Semi-Supervised Learning
    Osada, Genki
    Ahsan, Budrul
    Prasad Bora, Revoti
    Nishide, Takashi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (03) : 667 - 678
  • [26] Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
    Miyato, Takeru
    Maeda, Shin-Ichi
    Koyama, Masanori
    Ishii, Shin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (08) : 1979 - 1993
  • [27] Joint Entity-Relation Extraction Model for Epidemiological Reports Based on SMART Adversarial Training
    Sun, Jiazheng
    Yan, Huaicheng
    Li, Yue
    Li, Hao
    Bai, Ke
    Li, Zhichen
    2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 141 - 146
  • [28] A Robust De-noising Method via Training Loss for Distantly Supervised Relation Extraction
    Li, Yunpeng
    Hu, Yue
    Guo, Ping
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [29] Semantic piecewise convolutional neural network with adaptive negative training for distantly supervised relation extraction
    Yu, Mei
    Chen, Yunke
    Zhao, Mankun
    Xu, Tianyi
    Yu, Jian
    Yu, Ruiguo
    Liu, Hongwei
    Li, Xuewei
    NEUROCOMPUTING, 2023, 537 : 12 - 21
  • [30] Virtual Adversarial Training for Semi-supervised Verification Tasks
    Noroozi, Vahid
    Bahaadini, Sara
    Zheng, Lei
    Xie, Sihong
    Yu, Philip S.
    2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,