Automatic transfer learning for short text mining

被引:16
|
作者
Yang, Lei [1 ]
Zhang, Jianpei [1 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Nantong St 145, Harbin 150001, Peoples R China
关键词
Transfer learning; Short text mining; Latent semantic analysis;
D O I
10.1186/s13638-017-0815-5
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a new emerging technique, transfer learning enjoys the advantage of integrating the well-learnt knowledge from another related work to facilitate an improved learning result of one task. Most of the existing transfer learning methods are designed for long texts and short texts. However, the latter one distinguishes from the former one in terms of its sparse nature, noise words, syntactical structure, and colloquial terminologies used. A transfer learning algorithm called automatic transfer learning (AutoTL) is proposed for short text mining. By transferring knowledge automatically learnt from theonline information, the proposed method enables training data to be selected automatically. Furthermore, it does not make any a priori assumption about probability distribution. Our experimental results on 20Newsgroups, Simulated Real Auto Aviation, and Reuter-21578 validate the higher performance of the proposed AutoTL over several state-of-of-the-art methods.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Automatic transfer learning for short text mining
    Lei Yang
    Jianpei Zhang
    EURASIP Journal on Wireless Communications and Networking, 2017
  • [2] An automatic email distribution by using text mining and reinforcement learning
    Industrial Research Institute of Ishikawa, Kanazawa, 920-8203, Japan
    不详
    Syst Comput Jpn, 2006, 12 (82-95):
  • [3] Transfer Learning for Automatic Short Answer Grading
    Roy, Shourya
    Bhatt, Himanshu S.
    Narahari, Y.
    ECAI 2016: 22ND EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, 285 : 1622 - 1623
  • [4] Automatic Action Extraction for Short Text Conversation Using Unsupervised Learning
    Yuvaraj, Senthil Ganesan
    Zamanirad, Shayan
    Benatallah, Boualem
    Rodriguez, Carlos
    WEB INFORMATION SYSTEMS ENGINEERING, WISE 2020, PT II, 2020, 12343 : 117 - 128
  • [5] A method for automatic construction of learning contents in semantic web by a text mining approach
    Yang, Hsin-Chang
    INTERNATIONAL JOURNAL OF KNOWLEDGE AND LEARNING, 2006, 2 (1-2) : 89 - 105
  • [6] Automatic Essay Scoring for Arabic Short Answer Questions using Text Mining Techniques
    Meccawy, Maram
    Bayazed, Afnan Ali
    Al-Abdullah, Bashayer
    Algamdi, Hind
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (06) : 768 - 775
  • [7] Transfer Learning in Large-Scale Short Text Analysis
    Chu, Yan
    Wang, Zhengkui
    Chen, Man
    Xia, Linlin
    Wei, Fengmei
    Cai, Mengnan
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2015, 2015, 9403 : 499 - 511
  • [8] Wasserstein Selective Transfer Learning for Cross-domain Text Mining
    Feng, Lingyun
    Qiu, Minghui
    Li, Yaliang
    Zheng, Hai-Tao
    Shen, Ying
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 9772 - 9783
  • [9] A text mining approach for automatic construction of hypertexts
    Yang, HC
    Lee, CH
    EXPERT SYSTEMS WITH APPLICATIONS, 2005, 29 (04) : 723 - 734
  • [10] Context Aware Automatic Subjective and Objective Question Generation using Fast Text to Text Transfer Learning
    Agrawal, Arpit
    Shukla, Pragya
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (04) : 456 - 463