Detecting ongoing events using contextual word and sentence embeddings

被引:1
|
作者
Maisonnave, Mariano [1 ]
Delbianco, Fernando [1 ]
Tohme, Fernando [1 ]
Maguitman, Ana [1 ]
Milios, Evangelos [2 ]
机构
[1] Univ Nacl Sur, Bahia Blanca, Buenos Aires, Argentina
[2] Dalhousie Univ, Halifax, NS, Canada
关键词
Ongoing Event Detection; Information Extraction; Contextual embeddings; BERT; RNN; CNN; EXTRACTION;
D O I
10.1016/j.eswa.2022.118257
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces the Ongoing Event Detection (OED) task, which is a specific Event Detection task where the goal is to detect ongoing event mentions only, as opposed to historical, future, hypothetical, or other forms or events that are neither fresh nor current. Any application that needs to extract structured information about ongoing events from unstructured texts can take advantage of an OED system. The main contribution of this paper are the following: (1) it introduces the OED task along with a dataset manually labeled for the task; (2) it presents the design and implementation of an RNN model for the task that uses BERT embeddings to define contextual word and contextual sentence embeddings as attributes, which to the best of our knowledge were never used before for detecting ongoing events in news; (3) it presents an extensive empirical evaluation that includes (i) the exploration of different architectures and hyperparameters, (ii) an ablation test to study the impact of each attribute, and (iii) a comparison with a replication of a state-of-the-art model. The results offer several insights into the importance of contextual embeddings and indicate that the proposed approach is effective in the OED task, outperforming the baseline models.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Detecting Paraphrases for Portuguese using Word and Sentence Embeddings
    Souza, Marlo
    Sanches, Leandro M. P.
    LINGUAMATICA, 2018, 10 (02): : 31 - 44
  • [2] Single document summarization using word and sentence embeddings
    Ayana
    PROCEEDINGS OF THE 2015 JOINT INTERNATIONAL MECHANICAL, ELECTRONIC AND INFORMATION TECHNOLOGY CONFERENCE (JIMET 2015), 2015, 10 : 523 - 526
  • [3] Exploring fake news identification using word and sentence embeddings
    Priyanga, V. T.
    Sanjanasri, J. P.
    Menon, Vijay Krishna
    Gopalakrishnan, E. A.
    Soman, K. P.
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 41 (05) : 5441 - 5448
  • [4] Learning Word and Sentence Embeddings Using a Generative Convolutional Network
    Vargas-Ocampo, Edgar
    Roman-Rangel, Edgar
    Hermosillo-Valadez, Jorge
    PATTERN RECOGNITION, 2018, 10880 : 135 - 144
  • [5] Developing a sentence level fairness metric using word embeddings
    Ahmed Izzidien
    Stephen Fitz
    Peter Romero
    Bao S. Loe
    David Stillwell
    International Journal of Digital Humanities, 2023, 5 (2-3) : 95 - 130
  • [6] Comparative Study of Sentence Embeddings for Contextual Paraphrasing
    Pragst, Louisa
    Minker, Wolfgang
    Ultes, Stefan
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 6841 - 6851
  • [7] Metaphor Detection Using Contextual Word Embeddings From Transformers
    Liu, Jerry
    O'Hara, Nathan
    Rubin, Alexander
    Draelos, Rachel
    Rudin, Cynthia
    FIGURATIVE LANGUAGE PROCESSING, 2020, : 250 - 255
  • [8] Improving Implicit Stance Classification in Tweets Using Word and Sentence Embeddings
    Schaefer, Robin
    Stede, Manfred
    ADVANCES IN ARTIFICIAL INTELLIGENCE, KI 2019, 2019, 11793 : 299 - 307
  • [9] Carrier Sentence Selection with Word and Context Embeddings
    Yeung, Chak Yan
    Lee, John
    Tsou, Benjamin
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2019, : 439 - 444
  • [10] Early Detection of Severe Flu Outbreaks using Contextual Word Embeddings
    Karsi, Redouane
    Zaim, Mounia
    El Alami, Jamila
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (02) : 212 - 219