Transfer latent variable model based on divergence analysis

被引:18
|
作者
Gao, Xinbo [2 ]
Wang, Xiumei [2 ]
Li, Xuelong [1 ]
Tao, Dacheng [3 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, State Key Lab Transient Opt & Photon, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Dimensionality reduction; Latent variable model; Transfer learning; Bregman divergence; DIMENSIONALITY REDUCTION; COMPONENT ANALYSIS;
D O I
10.1016/j.patcog.2010.06.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent variable models are powerful dimensionality reduction approaches in machine learning and pattern recognition. However, this kind of methods only works well under a necessary and strict assumption that the training samples and testing samples are independent and identically distributed. When the samples come from different domains, the distribution of the testing dataset will not be identical with the training dataset. Therefore, the performance of latent variable models will be degraded for the reason that the parameters of the training model do not suit for the testing dataset. This case limits the generalization and application of the traditional latent variable models. To handle this issue, a transfer learning framework for latent variable model is proposed which can utilize the distance (or divergence) of the two datasets to modify the parameters of the obtained latent variable model. So we do not need to rebuild the model and only adjust the parameters according to the divergence, which will adopt different datasets. Experimental results on several real datasets demonstrate the advantages of the proposed framework. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2358 / 2366
页数:9
相关论文
共 50 条
  • [11] The stochastic conditional duration model: a latent variable model for the analysis of financial durations
    Bauwens, L
    Veredas, D
    JOURNAL OF ECONOMETRICS, 2004, 119 (02) : 381 - 412
  • [12] Supervised Gaussian Process Latent Variable Model Based on Gaussian Mixture Model
    Zhang, Jiayuan
    Zhu, Ziqi
    Zou, Jixin
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 124 - 129
  • [13] Multimodal latent variable analysis
    Papyan, Vardan
    Talmon, Ronen
    SIGNAL PROCESSING, 2018, 142 : 178 - 187
  • [14] The Latent Variable-Autoregressive Latent Trajectory Model: A General Framework for Longitudinal Data Analysis
    Bianconcini, Silvia
    Bollen, Kenneth A.
    STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2018, 25 (05) : 791 - 808
  • [15] Transfer of a Nanoparticle Product Between Different Mixers Using Latent Variable Model Inversion
    Tomba, Emanuele
    Meneghetti, Natascia
    Facco, Pierantonio
    Zelenkova, Tereza
    Barresi, Antonello A.
    Marchisio, Daniele L.
    Bezzo, Fabrizio
    Barolo, Massimiliano
    AICHE JOURNAL, 2014, 60 (01) : 123 - 135
  • [16] Supporting the transfer of products between different equipment through latent variable model inversion
    Meneghetti, N.
    Tomba, E.
    Facco, P.
    Lince, F.
    Marchisio, D. L.
    Barresi, A. A.
    Bezzo, F.
    Barolo, M.
    23 EUROPEAN SYMPOSIUM ON COMPUTER AIDED PROCESS ENGINEERING, 2013, 32 : 511 - 516
  • [17] Latent variable model and its application to Bayesian operational modal analysis
    Zhu, Wei
    Li, Bin-Bin
    Xie, Yan-Long
    Chen, Xiao-Yu
    Zhendong Gongcheng Xuebao/Journal of Vibration Engineering, 2024, 37 (09): : 1476 - 1484
  • [18] Variational Bayesian analysis for two-part latent variable model
    Xia, Yemao
    Chen, Jinye
    Jiang, Depeng
    COMPUTATIONAL STATISTICS, 2024, 39 (04) : 2259 - 2290
  • [19] Bayesian Analysis of ARCH-M model with a dynamic latent variable
    Song, Zefang
    Song, Xinyuan
    Li, Yuan
    ECONOMETRICS AND STATISTICS, 2023, 28 : 47 - 62
  • [20] Variational Bayesian analysis for two-part latent variable model
    Yemao Xia
    Jinye Chen
    Depeng Jiang
    Computational Statistics, 2024, 39 : 2259 - 2290