Semantic textual similarity between sentences using bilingual word semantics

被引:21
|
作者
Shajalal, Md [1 ]
Aono, Masaki [2 ]
机构
[1] Bangladesh Agr Univ, Dept Comp Sci & Math, Mymensingh 2202, Bangladesh
[2] Toyohashi Univ Technol, Dept Comp Sci & Engn, Toyohashi, Aichi, Japan
基金
日本学术振兴会;
关键词
Semantic similarity; Word semantics; Word-embedding; Textual similarity; Bilingual semantics;
D O I
10.1007/s13748-019-00180-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semantic textual similarity between sentences is indispensable for many information retrieval tasks. Traditional lexical similarity measures cannot compute the similarity beyond a trivial level. Moreover, they only can capture the textual similarity, but not semantic. In this paper, we propose a method for semantic textual similarity that leverages bilingual word-level semantics to compute the semantic similarity between sentences. To capture word-level semantics, we employ distribute representation of words in two different languages. The similarity function based on the concept-to-concept relationship corresponding to the words is also utilized for the same purpose. Multiple new semantic similarity measures are introduced based on word-embedding models trained on two different corpora in two different languages. Apart from these, another new semantic similarity measure is also introduced using the word sense comparison. The similarity score between the sentences is then computed by applying a linear ranking approach to all proposed measures with their importance score estimated employing a supervised feature selection technique. We conducted experiments on the SemEval Semantic Textual Similarity (STS-2017) test collections. The experimental results demonstrated that our method is effective for measuring semantic textual similarity and outperforms some known related methods.
引用
收藏
页码:263 / 272
页数:10
相关论文
共 50 条
  • [1] Semantic textual similarity between sentences using bilingual word semantics
    Md. Shajalal
    Masaki Aono
    Progress in Artificial Intelligence, 2019, 8 : 263 - 272
  • [2] Sentence-Level Semantic Textual Similarity Using Word-Level Semantics
    Shajalal, Md
    Aono, Masaki
    2018 10TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (ICECE), 2018, : 113 - 116
  • [3] Semantic Textual Similarity of Sentences with Emojis
    Debnath, Alok
    Pinnaparaju, Nikhil
    Shrivastava, Manish
    Varma, Vasudeva
    Augenstein, Isabelle
    WWW'20: COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2020, 2020, : 426 - 430
  • [4] Interpretable semantic textual similarity: Finding and explaining differences between sentences
    Lopez-Gazpio, I.
    Maritxalar, M.
    Gonzalez-Agirre, A.
    Rigau, G.
    Uria, L.
    Agirre, E.
    KNOWLEDGE-BASED SYSTEMS, 2017, 119 : 186 - 199
  • [5] Multilingual Semantic Textual Similarity using Multilingual Word Representations
    Ahmed, Mahtab
    Dixit, Chahna
    Mercer, Robert E.
    Khan, Atif
    Samee, Muhammad Rifayat
    Urra, Felipe
    2020 IEEE 14TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2020), 2020, : 194 - 198
  • [6] SEMANTIC SIMILARITY BETWEEN SENTENCES
    HONECK, RP
    JOURNAL OF PSYCHOLINGUISTIC RESEARCH, 1973, 2 (02) : 137 - 151
  • [7] Interpretable semantic textual similarity of sentences using alignment of chunks with classification and regression
    Majumder, Goutam
    Pakray, Partha
    Das, Ranjita
    Pinto, David
    APPLIED INTELLIGENCE, 2021, 51 (10) : 7322 - 7349
  • [8] Interpretable semantic textual similarity of sentences using alignment of chunks with classification and regression
    Goutam Majumder
    Partha Pakray
    Ranjita Das
    David Pinto
    Applied Intelligence, 2021, 51 : 7322 - 7349
  • [9] Mapping sentences to concept transferred space for semantic textual similarity
    Huang, Heyan
    Wu, Hao
    Wei, Xiaochi
    Gao, Yang
    Shi, Shumin
    KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 60 (03) : 1353 - 1376
  • [10] Mapping sentences to concept transferred space for semantic textual similarity
    Heyan Huang
    Hao Wu
    Xiaochi Wei
    Yang Gao
    Shumin Shi
    Knowledge and Information Systems, 2019, 60 : 1353 - 1376