Detecting ongoing events using contextual word and sentence embeddings

被引:1
|
作者
Maisonnave, Mariano [1 ]
Delbianco, Fernando [1 ]
Tohme, Fernando [1 ]
Maguitman, Ana [1 ]
Milios, Evangelos [2 ]
机构
[1] Univ Nacl Sur, Bahia Blanca, Buenos Aires, Argentina
[2] Dalhousie Univ, Halifax, NS, Canada
关键词
Ongoing Event Detection; Information Extraction; Contextual embeddings; BERT; RNN; CNN; EXTRACTION;
D O I
10.1016/j.eswa.2022.118257
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces the Ongoing Event Detection (OED) task, which is a specific Event Detection task where the goal is to detect ongoing event mentions only, as opposed to historical, future, hypothetical, or other forms or events that are neither fresh nor current. Any application that needs to extract structured information about ongoing events from unstructured texts can take advantage of an OED system. The main contribution of this paper are the following: (1) it introduces the OED task along with a dataset manually labeled for the task; (2) it presents the design and implementation of an RNN model for the task that uses BERT embeddings to define contextual word and contextual sentence embeddings as attributes, which to the best of our knowledge were never used before for detecting ongoing events in news; (3) it presents an extensive empirical evaluation that includes (i) the exploration of different architectures and hyperparameters, (ii) an ablation test to study the impact of each attribute, and (iii) a comparison with a replication of a state-of-the-art model. The results offer several insights into the importance of contextual embeddings and indicate that the proposed approach is effective in the OED task, outperforming the baseline models.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Evaluating the Impact of Content Deletion on Tabular Data Similarity and Retrieval Using Contextual Word Embeddings
    Berenguer, Alberto
    Tomas, David
    Mazon, Jose-Norberto
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2024, PT II, 2024, 14609 : 433 - 447
  • [42] Word Embeddings-based Sentence-Level Sentiment Analysis considering Word Importance
    Hayashi, Toshitaka
    Fujita, Hamido
    ACTA POLYTECHNICA HUNGARICA, 2019, 16 (07) : 7 - 24
  • [43] DefSent: Sentence Embeddings using Definition Sentences
    Tsukagoshi, Hayato
    Sasano, Ryohei
    Takeda, Koichi
    ACL-IJCNLP 2021: THE 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 2, 2021, : 411 - 418
  • [44] Contextual Word Embeddings Clustering Through Multiway Analysis: A Comparative Study
    Ait-Saada, Mira
    Nadif, Mohamed
    ADVANCES IN INTELLIGENT DATA ANALYSIS XXI, IDA 2023, 2023, 13876 : 1 - 14
  • [45] Contextual Generation of Word Embeddings for Out of Vocabulary Words in Downstream Tasks
    Garneau, Nicolas
    Leboeuf, Jean-Samuel
    Lamontagne, Luc
    ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, 11489 : 563 - 569
  • [46] Detecting Emerging Associations and Behaviors With Regional and Diachronic Word Embeddings
    Wolfe, Robert
    Caliskan, Aylin
    16TH IEEE INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2022), 2022, : 91 - 98
  • [47] Detecting gender bias in Arabic text through word embeddings
    Mourad, Aya
    Abu Salem, Fatima K.
    Elbassuoni, Shady
    PLOS ONE, 2025, 20 (03):
  • [48] Regressing Word and Sentence Embeddings for Low-Resource Neural Machine Translation
    Unanue I.J.
    Borzeshi E.Z.
    Piccardi M.
    IEEE Transactions on Artificial Intelligence, 2023, 4 (03): : 450 - 463
  • [49] Detecting Contextual Word Polarity using Aspect based Sentiment Analysis and Logistic Regression
    Rafeek, Roshna
    Remya, R.
    2017 IEEE INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES AND MANAGEMENT FOR COMPUTING, COMMUNICATION, CONTROLS, ENERGY AND MATERIALS (ICSTM), 2017, : 102 - 107
  • [50] Comparing the Performance of Neural and Statistical Sentence Embeddings on Summarization and Word Sense Disambiguation
    Juvekar, Gaurav
    Lolage, Abhishek
    Sahasrabudhe, Dhruva
    Haribhakta, Yashodhara
    2018 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2018, : 1787 - 1792