Interpretable semantic textual similarity of sentences using alignment of chunks with classification and regression

被引:0
|
作者
Goutam Majumder
Partha Pakray
Ranjita Das
David Pinto
机构
[1] Lovely Professional University,
[2] National Institute of Technology Silchar,undefined
[3] National Institute of Technology Mizoram,undefined
[4] Benemérita Universidad Autónoma de Puebla,undefined
来源
Applied Intelligence | 2021年 / 51卷
关键词
Semantic textual similarity; Natural language understanding; Text classification; Multivariate regression;
D O I
暂无
中图分类号
学科分类号
摘要
The proposed work is focused on establishing an interpretable Semantic Textual Similarity (iSTS) method for a pair of sentences, which can clarify why two sentences are completely or partially similar or have some variations. This proposed interpretable approach is a pipeline of five modules that begins with the pre-processing and chunking of text. Further chunks of two sentences are aligned using a one–to–multi (1:M) chunk aligner. Thereafter, support vector, Gaussian Naive Bayes and k–Nearest Neighbours classifiers are then used to create a multiclass classification algorithm, and different class labels are used to define an alignment type. At last, a multivariate regression algorithm is developed to find the semantic equivalence of an alignment with a score (that ranges from 0 to 5). The efficiency of the proposed method is verified on three different datasets and also compared to other state–of–the–art interpretable STS (iSTS) methods. The evaluated results show that the proposed method performs better than other iSTS methods. Most importantly, the modules of the proposed iSTS method are used to develop a Textual Entailment (TE) method. It is found that, when we combined chunk level, alignment, and sentence level features the entailment results significantly improves.
引用
收藏
页码:7322 / 7349
页数:27
相关论文
共 50 条
  • [1] Interpretable semantic textual similarity of sentences using alignment of chunks with classification and regression
    Majumder, Goutam
    Pakray, Partha
    Das, Ranjita
    Pinto, David
    APPLIED INTELLIGENCE, 2021, 51 (10) : 7322 - 7349
  • [2] Interpretable semantic textual similarity: Finding and explaining differences between sentences
    Lopez-Gazpio, I.
    Maritxalar, M.
    Gonzalez-Agirre, A.
    Rigau, G.
    Uria, L.
    Agirre, E.
    KNOWLEDGE-BASED SYSTEMS, 2017, 119 : 186 - 199
  • [3] Semantic Textual Similarity of Sentences with Emojis
    Debnath, Alok
    Pinnaparaju, Nikhil
    Shrivastava, Manish
    Varma, Vasudeva
    Augenstein, Isabelle
    WWW'20: COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2020, 2020, : 426 - 430
  • [4] Interpretable Semantic Textual Similarity for Indonesian Sentence
    Rajagukguk, Rio Chandra
    Khodra, Masayu Leylia
    2018 5TH INTERNATIONAL CONFERENCE ON ADVANCED INFORMATICS: CONCEPTS, THEORY AND APPLICATIONS (ICAICTA 2018), 2018, : 147 - 152
  • [5] Measuring interpretable semantic similarity of sentences using a multi chunk aligner
    Majumder, Goutam
    Pakray, Partha
    Pinto, David
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 36 (05) : 4797 - 4808
  • [6] Semantic textual similarity between sentences using bilingual word semantics
    Shajalal, Md
    Aono, Masaki
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2019, 8 (02) : 263 - 272
  • [7] Semantic textual similarity between sentences using bilingual word semantics
    Md. Shajalal
    Masaki Aono
    Progress in Artificial Intelligence, 2019, 8 : 263 - 272
  • [8] Mapping sentences to concept transferred space for semantic textual similarity
    Huang, Heyan
    Wu, Hao
    Wei, Xiaochi
    Gao, Yang
    Shi, Shumin
    KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 60 (03) : 1353 - 1376
  • [9] Mapping sentences to concept transferred space for semantic textual similarity
    Heyan Huang
    Hao Wu
    Xiaochi Wei
    Yang Gao
    Shumin Shi
    Knowledge and Information Systems, 2019, 60 : 1353 - 1376
  • [10] Text summary evaluation based on interpretable semantic textual similarity
    Goutam Majumder
    Vikrant Rajput
    Partha Pakray
    Sivaji Bandyopadhyay
    Benoit Favre
    Multimedia Tools and Applications, 2024, 83 : 3233 - 3258