Automatic transfer learning for short text mining

被引:16
|
作者
Yang, Lei [1 ]
Zhang, Jianpei [1 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Nantong St 145, Harbin 150001, Peoples R China
关键词
Transfer learning; Short text mining; Latent semantic analysis;
D O I
10.1186/s13638-017-0815-5
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a new emerging technique, transfer learning enjoys the advantage of integrating the well-learnt knowledge from another related work to facilitate an improved learning result of one task. Most of the existing transfer learning methods are designed for long texts and short texts. However, the latter one distinguishes from the former one in terms of its sparse nature, noise words, syntactical structure, and colloquial terminologies used. A transfer learning algorithm called automatic transfer learning (AutoTL) is proposed for short text mining. By transferring knowledge automatically learnt from theonline information, the proposed method enables training data to be selected automatically. Furthermore, it does not make any a priori assumption about probability distribution. Our experimental results on 20Newsgroups, Simulated Real Auto Aviation, and Reuter-21578 validate the higher performance of the proposed AutoTL over several state-of-of-the-art methods.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Mining annotators’ common knowledge for automatic text revision
    Siragusa G.
    DiCaro L.
    Tosalli M.
    International Journal of Metadata, Semantics and Ontologies, 2019, 13 (03) : 254 - 263
  • [22] Text mining through semi automatic semantic annotation
    Kiyavitskaya, Nadzeya
    Zeni, Nicola
    Mich, Luisa
    Cordy, James R.
    Mylopoulos, John
    PRACTICAL ASPECTS OF KNOWLEDGE MANAGEMENT, PROCEEDINGS, 2006, 4333 : 143 - +
  • [23] EduMiner: Using text mining for automatic formative assessment
    Hsu, Jung-Lung
    Chou, Huey-Wen
    Chang, Hsiu-Hua
    EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (04) : 3431 - 3439
  • [24] Text mining for automatic annotation of microarray experiment clusters
    Tkachenko, Aleksandr
    Tretjakov, Konstantin
    Adler, Priit
    Vilo, Jaak
    DATABASES AND INFORMATION SYSTEMS, 2008, : 423 - 426
  • [25] Automatic text categorization with learning logic
    Al-Mubaid, H
    Siddiqui, MS
    COMPUTER APPLICATIONS IN INDUSTRY AND ENGINEERING, 2003, : 178 - 183
  • [26] Fuzzy topic modeling approach for text mining over short text
    Rashid, Junaid
    Shah, Syed Muhammad Adnan
    Irtaza, Aun
    INFORMATION PROCESSING & MANAGEMENT, 2019, 56 (06)
  • [27] Improving the performance of automatic short answer grading using transfer learning and augmentation
    Bonthu, Sridevi
    Sree, S. Rama
    Prasad, M. H. M. Krishna
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [28] Short Text Mining for Classifying Educational Objectives and Outcomes
    Asiri, Yousef
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2022, 41 (01): : 35 - 50
  • [29] Opinion Mining on Non-English Short Text
    Akbas, Esra
    FOUNDATIONS OF INTELLIGENT SYSTEMS, ISMIS 2017, 2017, 10352 : 417 - 423
  • [30] Mining Summary of Short Text with Centroid Similarity Distance
    Franciscus, Nigel
    Wang, Junhu
    Stantic, Bela
    ADVANCED DATA MINING AND APPLICATIONS, ADMA 2019, 2019, 11888 : 447 - 461