Adversarial training for supervised relation extraction

被引:4
|
作者
Yu, Yanhua [1 ]
He, Kanghao [1 ]
Li, Jie [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Natl Pilot Software Engn Sch, Sch Comp Sci, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
relation extraction; piecewise convolution neural network; adversarial training; generative adversarial network; ATTENTION;
D O I
10.26599/TST.2020.9010059
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most supervised methods for relation extraction (RE) involve time-consuming human annotation. Distant supervision for RE is an efficient method to obtain large corpora that contains thousands of instances and various relations. However, the existing approaches rely heavily on knowledge bases (e.g., Freebase), thereby introducing data noise. Various relations and noisy labeling instances make the issue difficult to solve. In this study, we propose a model based on a piecewise convolution neural network with adversarial training. Inspired by generative adversarial networks, we adopt a heuristic algorithm to identify noisy datasets and apply adversarial training to RE. Experiments on the extended dataset of SemEval-2010 Task 8 show that our model can obtain more accurate training data for RE and significantly outperforms several competitive baseline models. Our model has an Fi score of 89.61%.
引用
收藏
页码:610 / 618
页数:9
相关论文
共 50 条
  • [1] Adversarial Training for Supervised Relation Extraction
    Yanhua Yu
    Kanghao He
    Jie Li
    TsinghuaScienceandTechnology, 2022, 27 (03) : 610 - 618
  • [2] Empower Distantly Supervised Relation Extraction with Collaborative Adversarial Training
    Chen, Tao
    Shi, Haochen
    Liu, Liyuan
    Tang, Siliang
    Shao, Jian
    Chen, Zhigang
    Zhuang, Yueting
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 12675 - 12682
  • [3] Knowing False Negatives: An Adversarial Training Method for Distantly Supervised Relation Extraction
    Hao, Kailong
    Yu, Botao
    Hu, Wei
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 9661 - 9672
  • [4] Adversarial Learning for Distant Supervised Relation Extraction
    Zeng, Daojian
    Dai, Yuan
    Li, Feng
    Sherratt, R. Simon
    Wang, Jin
    CMC-COMPUTERS MATERIALS & CONTINUA, 2018, 55 (01): : 121 - 136
  • [5] DSGAN: Generative Adversarial Training for Distant Supervision Relation Extraction
    Qin, Pengda
    Xu, Weiran
    Wang, William Yang
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 496 - 505
  • [6] Adversarial Multi-Teacher Distillation for Semi-Supervised Relation Extraction
    Li, Wanli
    Qian, Tieyun
    Li, Xuhui
    Zou, Lixin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 11291 - 11301
  • [7] Adversarial training for multi-context joint entity and relation extraction
    Bekoulis, Giannis
    Deleu, Johannes
    Demeester, Thomas
    Develder, Chris
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 2830 - 2836
  • [8] GRAPH CONVOLUTIONAL NETWORKS & ADVERSARIAL TRAINING FOR JOINT EXTRACTION OF ENTITY AND RELATION
    Qu, Xiaolong
    Zhang, Yang
    Tian, Ziwei
    LI, Yuxun
    LI, Dongmei
    Zhang, Xiaoping
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2023, 85 (03): : 213 - 224
  • [9] GRAPH CONVOLUTIONAL NETWORKS & ADVERSARIAL TRAINING FOR JOINT EXTRACTION OF ENTITY AND RELATION
    Qu, Xiaolong
    Zhang, Yang
    Tian, Ziwei
    Li, Yuxun
    Li, Dongmei
    Zhang, Xiaoping
    UPB Scientific Bulletin, Series C: Electrical Engineering and Computer Science, 2023, 85 (03): : 213 - 224
  • [10] SELF-SUPERVISED ADVERSARIAL TRAINING
    Chen, Kejiang
    Chen, Yuefeng
    Zhou, Hang
    Mao, Xiaofeng
    Li, Yuhong
    He, Yuan
    Xue, Hui
    Zhang, Weiming
    Yu, Nenghai
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2218 - 2222