Comparing text corpora via topic modelling

被引:1
|
作者
Krasnov, Fedor [1 ]
Shvartsman, Mikhail [2 ]
Dimentov, Alexander [2 ]
机构
[1] Gazpromneft Sci & Technol Ctr, 75-79 Liter D Moika River Emb, St Petersburg 190000, Russia
[2] Russian State Lib, Natl Elect Informat Consortium, 4-5 Letnikovskaia St, Moscow 115114, Russia
关键词
topic modelling; text classification; ARTM; additive regularisation of topic models; PLSA; random forest; comparing text collections;
D O I
10.1504/IJDMMM.2022.10050161
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A method is developed for conducting comparative analysis on the content of full text patents collections. Named T4C, the approach is based on topic modelling and machine learning and extends comparative text mining. The idea of T4C was inspired by the possibility of precise topics extracting from a joint collection of texts and following analysing the parts of collection on the topics. The different aspects of meta information of the patents full texts collection are considered. The ownership of a patent in a particular country can be identified with an accuracy of 97.5% by using supervised machine learning. By studying how patents vary with time, those belonging to a specific period can be identified with an accuracy of 85% for a given country. Also developed is a visual representation of the thematic correlation between groups of patents. In terms of the text composition of patent descriptions, Chinese patents differ fundamentally from US patents. T4C method is valid for structured medium-sized collections of texts in English. The experimental results are used to manage the patenting process at GazpromNeft STC.
引用
收藏
页码:203 / 216
页数:15
相关论文
共 50 条
  • [31] Topic Controlled Steganography via Graph-to-Text Generation
    Sun, Bowen
    Li, Yamin
    Zhang, Jun
    Xu, Honghong
    Ma, Xiaoqiang
    Xia, Ping
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 136 (01): : 157 - 176
  • [32] Image retrieval via topic modelling of Instagram hashtags
    Tsapatsoulis, Nicolas
    2020 15TH INTERNATIONAL WORKSHOP ON SEMANTIC AND SOCIAL MEDIA ADAPTATION AND PERSONALIZATION (SMAP 2020), 2020, : 62 - 69
  • [33] Mining Cluster Patterns in XML Corpora via Latent Topic Models of Content and Structure
    Costa, Gianni
    Ortale, Riccardo
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2019, PT III, 2019, 11441 : 237 - 248
  • [34] TEXT CORPORA, LEXICOGRAPHERS NEEDS
    SINCLAIR, JM
    ZEITSCHRIFT FUR ANGLISTIK UND AMERIKANISTIK, 1993, 41 (01): : 5 - 14
  • [35] STYLISTICS: TEXT, COGNITION AND CORPORA
    Ritonga, Apri Wardana
    Desrani, Ayu
    JOURNAL OF LANGUAGE AND EDUCATION, 2024, 10 (03): : 183 - 185
  • [36] Searching text corpora with grep
    Obrebski, Tomasz
    Intelligent Information Processing and Web Mining, Proceedings, 2006, : 353 - 357
  • [37] CORPORA AND TEXT BOOK DESIGN
    Grazib, Mohamed
    5TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION (ICERI 2012), 2012, : 1940 - 1947
  • [39] Text Corpora and Multilingual Lexicography
    Maniez, Francois
    TERMINOLOGY, 2008, 14 (02): : 266 - 271
  • [40] On Modeling and Querying of Text Corpora
    Liu, Dingjia
    Liu, Guohua
    Liu, Yuanyuan
    2014 TENTH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2014, : 299 - 303