Comparing text corpora via topic modelling

被引:1
|
作者
Krasnov, Fedor [1 ]
Shvartsman, Mikhail [2 ]
Dimentov, Alexander [2 ]
机构
[1] Gazpromneft Sci & Technol Ctr, 75-79 Liter D Moika River Emb, St Petersburg 190000, Russia
[2] Russian State Lib, Natl Elect Informat Consortium, 4-5 Letnikovskaia St, Moscow 115114, Russia
关键词
topic modelling; text classification; ARTM; additive regularisation of topic models; PLSA; random forest; comparing text collections;
D O I
10.1504/IJDMMM.2022.10050161
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A method is developed for conducting comparative analysis on the content of full text patents collections. Named T4C, the approach is based on topic modelling and machine learning and extends comparative text mining. The idea of T4C was inspired by the possibility of precise topics extracting from a joint collection of texts and following analysing the parts of collection on the topics. The different aspects of meta information of the patents full texts collection are considered. The ownership of a patent in a particular country can be identified with an accuracy of 97.5% by using supervised machine learning. By studying how patents vary with time, those belonging to a specific period can be identified with an accuracy of 85% for a given country. Also developed is a visual representation of the thematic correlation between groups of patents. In terms of the text composition of patent descriptions, Chinese patents differ fundamentally from US patents. T4C method is valid for structured medium-sized collections of texts in English. The experimental results are used to manage the patenting process at GazpromNeft STC.
引用
收藏
页码:203 / 216
页数:15
相关论文
共 50 条
  • [1] Learning Author-Topic Models from Text Corpora
    Rosen-Zvi, Michal
    Chemudugunta, Chaitanya
    Griffiths, Thomas
    Smyth, Padhraic
    Steyvers, Mark
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2010, 28 (01)
  • [2] TopicNets: Visual Analysis of Large Text Corpora with Topic Modeling
    Gretarsson, Brynjar
    O'Donovan, John
    Bostandjiev, Svetlin
    Hoellerer, Tobias
    Asuncion, Arthur
    Newman, David
    Smyth, Padhraic
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2012, 3 (02)
  • [3] Topic discovery in massive text corpora based on Min-Hashing
    Fuentes-Pineda, Gibran
    Meza-Ruiz, Ivan, V
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 136 : 62 - 72
  • [4] Embedding Semantic Anchors to Guide Topic Models on Short Text Corpora
    Steuber, Florian
    Schneider, Sinclair
    Schoenfeld, Mirco
    BIG DATA RESEARCH, 2022, 27
  • [5] Serendip: Topic Model-Driven Visual Exploration of Text Corpora
    Alexander, Eric
    Kohlmann, Joe
    Valenza, Robin
    Witmore, Michael
    Gleicher, Michael
    2014 IEEE CONFERENCE ON VISUAL ANALYTICS SCIENCE AND TECHNOLOGY (VAST), 2014, : 173 - 182
  • [6] Visual Analysis of Topic Transition among Different Sources of Text Corpora
    Zhang Y.
    Shao Y.
    Zhang J.
    1600, Institute of Computing Technology (29): : 2265 - 2272
  • [7] TopicView: Visually Comparing Topic Models of Text Collections
    Crossno, Patricia J.
    Wilson, Andrew T.
    Shead, Timothy M.
    Dunlavy, Daniel M.
    2011 23RD IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2011), 2011, : 936 - 943
  • [8] Unsupervised Anomaly Detection in Multi-Topic Short-Text Corpora
    Ait-Saada, Mira
    Nadif, Mohamed
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1392 - 1403
  • [9] TopExplorer: Tool Support for Extracting and Visualizing Topic Models in Bioengineering Text Corpora
    Cheng, Kwok Sun
    Wang, Zhipeng
    Huang, Pei-Chi
    Chundi, Parvathi
    Song, Myoungkyu
    2020 IEEE INTERNATIONAL CONFERENCE ON ELECTRO INFORMATION TECHNOLOGY (EIT), 2020, : 334 - 343
  • [10] A hierarchical topic modelling approach for short text clustering
    Pradhan R.
    Sharma D.K.
    International Journal of Information and Communication Technology, 2022, 20 (04): : 463 - 481