Comparing text corpora via topic modelling

被引:1
|
作者
Krasnov, Fedor [1 ]
Shvartsman, Mikhail [2 ]
Dimentov, Alexander [2 ]
机构
[1] Gazpromneft Sci & Technol Ctr, 75-79 Liter D Moika River Emb, St Petersburg 190000, Russia
[2] Russian State Lib, Natl Elect Informat Consortium, 4-5 Letnikovskaia St, Moscow 115114, Russia
关键词
topic modelling; text classification; ARTM; additive regularisation of topic models; PLSA; random forest; comparing text collections;
D O I
10.1504/IJDMMM.2022.10050161
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A method is developed for conducting comparative analysis on the content of full text patents collections. Named T4C, the approach is based on topic modelling and machine learning and extends comparative text mining. The idea of T4C was inspired by the possibility of precise topics extracting from a joint collection of texts and following analysing the parts of collection on the topics. The different aspects of meta information of the patents full texts collection are considered. The ownership of a patent in a particular country can be identified with an accuracy of 97.5% by using supervised machine learning. By studying how patents vary with time, those belonging to a specific period can be identified with an accuracy of 85% for a given country. Also developed is a visual representation of the thematic correlation between groups of patents. In terms of the text composition of patent descriptions, Chinese patents differ fundamentally from US patents. T4C method is valid for structured medium-sized collections of texts in English. The experimental results are used to manage the patenting process at GazpromNeft STC.
引用
收藏
页码:203 / 216
页数:15
相关论文
共 50 条
  • [41] A novel text clustering model based on topic modelling and social network analysis
    Amiri, Babak
    Karimianghadim, Ramin
    CHAOS SOLITONS & FRACTALS, 2024, 181
  • [42] Indexing Text Related to Software Vulnerabilities in Noisy Communities Through Topic Modelling
    Paradis, Carlos
    Kazman, Rick
    Wang, Ping
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 763 - 768
  • [43] Statistical parameterisation of text corpora
    Martynenko, GY
    Sherstinova, TY
    TEXT, SPEECH AND DIALOGUE, PROCEEDINGS, 2000, 1902 : 99 - 102
  • [44] Short and Sparse Text Topic Modeling via Self-Aggregation
    Quan, Xiaojun
    Kit, Chunyu
    Ge, Yong
    Pan, Sinno Jialin
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 2270 - 2276
  • [45] Enhanced Topic Identification Algorithm for Arabic Corpora
    Alsaad, Amal
    Abbod, Maysam
    2015 17TH UKSIM-AMSS INTERNATIONAL CONFERENCE ON COMPUTER MODELLING AND SIMULATION (UKSIM), 2015, : 90 - 94
  • [46] Medical Corpora Comparison Using Topic Modeling
    Shaikina, Alevtina A.
    Funkner, Anastasia A.
    9TH INTERNATIONAL YOUNG SCIENTISTS CONFERENCE IN COMPUTATIONAL SCIENCE, YSC2020, 2020, 178 : 244 - 253
  • [47] Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding
    Meng, Yu
    Zhang, Yunyi
    Huang, Jiaxin
    Zhang, Yu
    Zhang, Chao
    Han, Jiawei
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 1908 - 1917
  • [48] Research on Mining Common Concern via Infinite Topic Modelling
    Miao, Yishu
    Li, Chunping
    Ding, Qiang
    Li, Li
    2012 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE AND INTELLIGENT AGENT TECHNOLOGY WORKSHOPS (WI-IAT WORKSHOPS 2012), VOL 3, 2012, : 180 - 184
  • [49] Addressing topic modelling via reduced latent space clustering
    Schiavon, Lorenzo
    STATISTICAL METHODS AND APPLICATIONS, 2025,
  • [50] Text segmentation by topic
    Ponte, JM
    Croft, WB
    RESEARCH AND ADVANCED TECHNOLOGY FOR DIGITAL LIBRARIES, 1997, 1324 : 113 - 125