Semi-supervised Relation Extraction via Incremental Meta Self-Training

被引:0
|
作者
Hu, Xuming [1 ]
Zhang, Chenwei [2 ]
Ma, Fukun [1 ]
Liu, Chenyao [1 ]
Wen, Lijie [1 ]
Yu, Philip S. [1 ,3 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] Amazon, Bellevue, WA 98004 USA
[3] Univ Illinois, Chicago, IL USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To alleviate human efforts from obtaining large-scale annotations, Semi-Supervised Relation Extraction methods aim to leverage unlabeled data in addition to learning from limited samples. Existing self-training methods suffer from the gradual drift problem, where noisy pseudo labels on unlabeled data are incorporated during training. To alleviate the noise in pseudo labels, we propose a method called MetaSRE, where a Relation Label Generation Network generates quality assessment on pseudo labels by (meta) learning from the successful and failed attempts on Relation Classification Network as an additional metaobjective. To reduce the influence of noisy pseudo labels, MetaSRE adopts a pseudo label selection and exploitation scheme which assesses pseudo label quality on unlabeled samples and only exploits high-quality pseudo labels in a self-training fashion to incrementally augment labeled samples for both robustness and accuracy. Experimental results on two public datasets demonstrate the effectiveness of the proposed approach. Source code is available(1).
引用
收藏
页码:487 / 496
页数:10
相关论文
共 50 条
  • [1] Semi-Supervised Meta-Learning via Self-Training
    Zhou, Meng
    Li, Yaoyi
    Lu, Hongtao
    Cai Nengbin
    Zhao Xuejun
    2020 THE 3RD INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS'2020), 2020, : 1 - 7
  • [2] Semi-supervised Continual Learning with Meta Self-training
    Ho, Stella
    Liu, Ming
    Du, Lan
    Li, Yunfeng
    Gao, Longxiang
    Gao, Shang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 4024 - 4028
  • [3] Uncertainty-Aware Self-Training for Semi-Supervised Event Temporal Relation Extraction
    Cao, Pengfei
    Zuo, Xinyu
    Chen, Yubo
    Liu, Kang
    Zhao, Jun
    Bi, Wei
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2900 - 2904
  • [4] Debiased Self-Training for Semi-Supervised Learning
    Chen, Baixu
    Jiang, Junguang
    Wang, Ximei
    Wan, Pengfei
    Wang, Jianmin
    Long, Mingsheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [5] Semi-Supervised Gastrointestinal Stromal Tumor Detection via Self-Training
    Yang, Qi
    Cao, Ziran
    Jiang, Yaling
    Sun, Hanbo
    Gu, Xiaokang
    Xie, Fei
    Miao, Fei
    Gao, Gang
    ELECTRONICS, 2023, 12 (04)
  • [6] Semi-supervised self-training for sentence subjectivity classification
    Wang, Bin
    Spencer, Bruce
    Ling, Charles X.
    Zhang, Harry
    ADVANCES IN ARTIFICIAL INTELLIGENCE, 2008, 5032 : 344 - +
  • [7] Semi-supervised self-training for decision tree classifiers
    Tanha, Jafar
    van Someren, Maarten
    Afsarmanesh, Hamideh
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2017, 8 (01) : 355 - 370
  • [8] Semi-supervised Gait Recognition Based on Self-training
    Li, Yanan
    Yin, Yilong
    Liu, Lili
    Pang, Shaohua
    Yu, Qiuhong
    2012 IEEE NINTH INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL-BASED SURVEILLANCE (AVSS), 2012, : 288 - 293
  • [9] Semi-supervised self-training of object detection models
    Rosenberg, C
    Hebert, M
    Schneiderman, H
    WACV 2005: SEVENTH IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION, PROCEEDINGS, 2005, : 29 - 36
  • [10] Federated Self-training for Semi-supervised Audio Recognition
    Tsouvalas, Vasileios
    Saeed, Aaqib
    Ozcelebi, Tanir
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2022, 21 (06)