Transfer latent variable model based on divergence analysis

被引:18
|
作者
Gao, Xinbo [2 ]
Wang, Xiumei [2 ]
Li, Xuelong [1 ]
Tao, Dacheng [3 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, State Key Lab Transient Opt & Photon, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Dimensionality reduction; Latent variable model; Transfer learning; Bregman divergence; DIMENSIONALITY REDUCTION; COMPONENT ANALYSIS;
D O I
10.1016/j.patcog.2010.06.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent variable models are powerful dimensionality reduction approaches in machine learning and pattern recognition. However, this kind of methods only works well under a necessary and strict assumption that the training samples and testing samples are independent and identically distributed. When the samples come from different domains, the distribution of the testing dataset will not be identical with the training dataset. Therefore, the performance of latent variable models will be degraded for the reason that the parameters of the training model do not suit for the testing dataset. This case limits the generalization and application of the traditional latent variable models. To handle this issue, a transfer learning framework for latent variable model is proposed which can utilize the distance (or divergence) of the two datasets to modify the parameters of the obtained latent variable model. So we do not need to rebuild the model and only adjust the parameters according to the divergence, which will adopt different datasets. Experimental results on several real datasets demonstrate the advantages of the proposed framework. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2358 / 2366
页数:9
相关论文
共 50 条
  • [41] Latent variable analysis and signal separation
    Vigneron, V.
    Zarzoso, V.
    Gribonval, R.
    Vincent, E.
    SIGNAL PROCESSING, 2012, 92 (08) : 1765 - 1766
  • [42] Latent class analysis variable selection
    Dean, Nema
    Raftery, Adrian E.
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2010, 62 (01) : 11 - 35
  • [43] Analysis of Choice Behaviors of Railway Shippers for Freight Services Based on a Fuzzy Integrated Choice and Latent Variable Model
    Jing, Yun
    Xu, Wanglin
    Guo, Siye
    Zhang, Yingjin
    IEEE ACCESS, 2020, 8 : 64399 - 64410
  • [44] Bayesian Analysis of Two-Part Latent Variable Model with Mixed Data
    Xiong, Shuang-Can
    Xia, Ye-Mao
    Lu, Bin
    COMMUNICATIONS IN MATHEMATICS AND STATISTICS, 2023,
  • [45] An improved dynamic latent variable regression model for fault diagnosis and causal analysis
    Zhang, Haitian
    Zhu, Qinqin
    CANADIAN JOURNAL OF CHEMICAL ENGINEERING, 2023, 101 (06): : 3333 - 3350
  • [46] Maximum likelihood analysis of a general latent variable model with hierarchically mixed data
    Lee, SY
    Song, XY
    BIOMETRICS, 2004, 60 (03) : 624 - 636
  • [47] Age estimation based on improved discriminative Gaussian process latent variable model
    Lijun Cai
    Lei Huang
    Changping Liu
    Multimedia Tools and Applications, 2016, 75 : 11977 - 11994
  • [48] Age estimation based on improved discriminative Gaussian process latent variable model
    Cai, Lijun
    Huang, Lei
    Liu, Changping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (19) : 11977 - 11994
  • [49] Learning Visual Object Categories and Their Composition Based on a Probabilistic Latent Variable Model
    Atsumi, Masayasu
    NEURAL INFORMATION PROCESSING: THEORY AND ALGORITHMS, PT I, 2010, 6443 : 247 - 254
  • [50] A change validation system for aerial images based on a probabilistic latent variable model
    Nava, FP
    PATTERN RECOGNITION AND IMAGE ANALYSIS, PROCEEDINGS, 2003, 2652 : 748 - 757