Transfer latent variable model based on divergence analysis

被引:18
|
作者
Gao, Xinbo [2 ]
Wang, Xiumei [2 ]
Li, Xuelong [1 ]
Tao, Dacheng [3 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, State Key Lab Transient Opt & Photon, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Dimensionality reduction; Latent variable model; Transfer learning; Bregman divergence; DIMENSIONALITY REDUCTION; COMPONENT ANALYSIS;
D O I
10.1016/j.patcog.2010.06.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent variable models are powerful dimensionality reduction approaches in machine learning and pattern recognition. However, this kind of methods only works well under a necessary and strict assumption that the training samples and testing samples are independent and identically distributed. When the samples come from different domains, the distribution of the testing dataset will not be identical with the training dataset. Therefore, the performance of latent variable models will be degraded for the reason that the parameters of the training model do not suit for the testing dataset. This case limits the generalization and application of the traditional latent variable models. To handle this issue, a transfer learning framework for latent variable model is proposed which can utilize the distance (or divergence) of the two datasets to modify the parameters of the obtained latent variable model. So we do not need to rebuild the model and only adjust the parameters according to the divergence, which will adopt different datasets. Experimental results on several real datasets demonstrate the advantages of the proposed framework. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2358 / 2366
页数:9
相关论文
共 50 条
  • [31] Latent variable model for cluster ensemble
    Wang, Hong-Jun
    Li, Zhi-Shu
    Cheng, Yang
    Zhou, Peng
    Zhou, Wei
    Ruan Jian Xue Bao/Journal of Software, 2009, 20 (04): : 825 - 833
  • [32] A latent variable model for chemogenomic profiling
    Flaherty, P
    Giaever, G
    Kumm, J
    Jordan, MI
    Arkin, AP
    BIOINFORMATICS, 2005, 21 (15) : 3286 - 3293
  • [33] A latent variable model for multivariate discretization
    Monti, S
    Cooper, GF
    ARTIFICIAL INTELLIGENCE AND STATISTICS 99, PROCEEDINGS, 1999, : 249 - 254
  • [34] Rapid Speaker Adaptation Based on Combination of KPCA and Latent Variable Model
    Zohreh Ansari
    Farshad Almasganj
    Seyed Jahanshah Kabudian
    Circuits, Systems, and Signal Processing, 2021, 40 : 3996 - 4017
  • [35] Research on uncertainty inference of associate projects based on the latent variable model
    Lin, Mu
    Li, Tongxin
    Wang, Tao
    Wang, Weiping
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 679 - 687
  • [36] A new classification algorithm based on Gaussian process latent variable model
    Wang, Xiu-Mei
    Gao, Xin-Bo
    Li, Jie
    Jisuanji Xuebao/Chinese Journal of Computers, 2012, 35 (12): : 2661 - 2667
  • [37] Rapid Speaker Adaptation Based on Combination of KPCA and Latent Variable Model
    Ansari, Zohreh
    Almasganj, Farshad
    Kabudian, Seyed Jahanshah
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2021, 40 (08) : 3996 - 4017
  • [38] Dirichlet Latent Variable Model: A Dynamic Model Based on Dirichlet Prior for Audio Processing
    Kumar, Anurendra
    Guha, Tanaya
    Ghosh, Prasanta Kumar
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (05) : 919 - 931
  • [39] Model-based analysis of latent factors
    Gregorius, Hans-Rolf
    WEB ECOLOGY, 2018, 18 (02) : 153 - 162
  • [40] Latent class analysis variable selection
    Nema Dean
    Adrian E. Raftery
    Annals of the Institute of Statistical Mathematics, 2010, 62 : 11 - 35