Automatic transfer learning for short text mining

被引:16
|
作者
Yang, Lei [1 ]
Zhang, Jianpei [1 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Nantong St 145, Harbin 150001, Peoples R China
关键词
Transfer learning; Short text mining; Latent semantic analysis;
D O I
10.1186/s13638-017-0815-5
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a new emerging technique, transfer learning enjoys the advantage of integrating the well-learnt knowledge from another related work to facilitate an improved learning result of one task. Most of the existing transfer learning methods are designed for long texts and short texts. However, the latter one distinguishes from the former one in terms of its sparse nature, noise words, syntactical structure, and colloquial terminologies used. A transfer learning algorithm called automatic transfer learning (AutoTL) is proposed for short text mining. By transferring knowledge automatically learnt from theonline information, the proposed method enables training data to be selected automatically. Furthermore, it does not make any a priori assumption about probability distribution. Our experimental results on 20Newsgroups, Simulated Real Auto Aviation, and Reuter-21578 validate the higher performance of the proposed AutoTL over several state-of-of-the-art methods.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] A text mining approach on automatic generation of web directories and hierarchies
    Yang, HC
    Lee, CH
    IEEE/WIC INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE, PROCEEDINGS, 2003, : 625 - 628
  • [42] Automatic Lyrics Classification System Using Text Mining Technique
    Jareanpon, Chatklaw
    Kiatjindarat, Waranyoo
    Polhome, Thanawat
    Khongkraphan, Kittiya
    2018 INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT), 2018,
  • [43] Automatic Content Analysis of Media Framing by Text Mining Techniques
    Lin, Fu-Ren
    Hao, De
    Liao, Dachi
    PROCEEDINGS OF THE 49TH ANNUAL HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES (HICSS 2016), 2016, : 2770 - 2779
  • [44] Manually structured digital abstracts: A scaffold for automatic text mining
    Seringhaus, Michael
    Gerstein, Mark
    FEBS LETTERS, 2008, 582 (08) : 1170 - 1170
  • [45] How unsafe acts occur: an automatic text mining study
    Shi, Xin
    Xu, Dong
    Zhuang, Hui
    Liu, Chen
    MARITIME POLICY & MANAGEMENT, 2022, 49 (06) : 820 - 830
  • [46] Automatic Content Analysis of Legislative Documents by Text Mining Techniques
    Lin, Fu-Ren
    Chou, Shih-Yao
    Liao, Dachi
    Hao, De
    2015 48TH HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES (HICSS), 2015, : 2199 - 2208
  • [47] A text mining approach on automatic generation of web directories and hierarchies
    Yang, HC
    Lee, CH
    EXPERT SYSTEMS WITH APPLICATIONS, 2004, 27 (04) : 645 - 663
  • [48] Representation Learning for Short Text Clustering
    Yin, Hui
    Song, Xiangyu
    Yang, Shuiqiao
    Huang, Guangyan
    Li, Jianxin
    WEB INFORMATION SYSTEMS ENGINEERING - WISE 2021, PT II, 2021, 13081 : 321 - 335
  • [49] Automatic Short Text Annotation for Question Answering System
    Liu, Gang
    Lu, Zhi
    Hao, Tianyong
    Liu, Wenyin
    WEB INFORMATION SYSTEMS AND TECHNOLOGIES, 2011, 75 : 245 - 258
  • [50] Deep learning in the automatic analysis of Czech text
    Strakova, Jana
    Straka, Milan
    Hajic, Jan
    Popel, Martin
    SLOVO A SLOVESNOST, 2019, 80 (04): : 306 - 327