Transfer latent variable model based on divergence analysis

被引:18
|
作者
Gao, Xinbo [2 ]
Wang, Xiumei [2 ]
Li, Xuelong [1 ]
Tao, Dacheng [3 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, State Key Lab Transient Opt & Photon, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Dimensionality reduction; Latent variable model; Transfer learning; Bregman divergence; DIMENSIONALITY REDUCTION; COMPONENT ANALYSIS;
D O I
10.1016/j.patcog.2010.06.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent variable models are powerful dimensionality reduction approaches in machine learning and pattern recognition. However, this kind of methods only works well under a necessary and strict assumption that the training samples and testing samples are independent and identically distributed. When the samples come from different domains, the distribution of the testing dataset will not be identical with the training dataset. Therefore, the performance of latent variable models will be degraded for the reason that the parameters of the training model do not suit for the testing dataset. This case limits the generalization and application of the traditional latent variable models. To handle this issue, a transfer learning framework for latent variable model is proposed which can utilize the distance (or divergence) of the two datasets to modify the parameters of the obtained latent variable model. So we do not need to rebuild the model and only adjust the parameters according to the divergence, which will adopt different datasets. Experimental results on several real datasets demonstrate the advantages of the proposed framework. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2358 / 2366
页数:9
相关论文
共 50 条
  • [21] A cognitive latent variable model for the simultaneous analysis of behavioral and personality data
    Vandekerckhove, Joachim
    JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2014, 60 : 58 - 71
  • [22] Ising distribution as a latent variable model
    Wohrer, Adrien
    PHYSICAL REVIEW E, 2019, 99 (04)
  • [23] A LATENT VARIABLE MODEL OF ASSORTATIVE MATING
    NEALE, MC
    BEHAVIOR GENETICS, 1989, 19 (06) : 770 - 771
  • [24] A latent variable model for ordinal variables
    Moustaki, I
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2000, 24 (03) : 211 - 223
  • [25] Nonparametric estimation of a latent variable model
    Kelava, Augustin
    Kohler, Michael
    Krzyzak, Adam
    Schaffland, Tim Fabian
    JOURNAL OF MULTIVARIATE ANALYSIS, 2017, 154 : 112 - 134
  • [26] A latent variable model for multidimensional unfolding
    Adachi, K
    NEW DEVELOPMENTS IN PSYCHOMETRICS, 2003, : 503 - 510
  • [27] Generalized threshold latent variable model
    Li, Yuanbo
    Zheng, Xunze
    Yau, Chun Yip
    ELECTRONIC JOURNAL OF STATISTICS, 2019, 13 (01): : 2043 - 2092
  • [28] VAE-Based Interpretable Latent Variable Model for Process Monitoring
    Pan, Zhuofu
    Wang, Yalin
    Cao, Yue
    Gui, Weihua
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 6075 - 6088
  • [29] Nonlinear Probabilistic Monitoring Based on the Gaussian Process Latent Variable Model
    Ge, Zhiqiang
    Song, Zhihuan
    INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2010, 49 (10) : 4792 - 4799
  • [30] Latent variable based model predictive control: Ensuring validity of predictions
    Lauri, D.
    Sanchis, J.
    Martinez, M.
    Hilario, A.
    JOURNAL OF PROCESS CONTROL, 2013, 23 (01) : 12 - 22