Transfer latent variable model based on divergence analysis

被引:18
|
作者
Gao, Xinbo [2 ]
Wang, Xiumei [2 ]
Li, Xuelong [1 ]
Tao, Dacheng [3 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, State Key Lab Transient Opt & Photon, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Dimensionality reduction; Latent variable model; Transfer learning; Bregman divergence; DIMENSIONALITY REDUCTION; COMPONENT ANALYSIS;
D O I
10.1016/j.patcog.2010.06.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent variable models are powerful dimensionality reduction approaches in machine learning and pattern recognition. However, this kind of methods only works well under a necessary and strict assumption that the training samples and testing samples are independent and identically distributed. When the samples come from different domains, the distribution of the testing dataset will not be identical with the training dataset. Therefore, the performance of latent variable models will be degraded for the reason that the parameters of the training model do not suit for the testing dataset. This case limits the generalization and application of the traditional latent variable models. To handle this issue, a transfer learning framework for latent variable model is proposed which can utilize the distance (or divergence) of the two datasets to modify the parameters of the obtained latent variable model. So we do not need to rebuild the model and only adjust the parameters according to the divergence, which will adopt different datasets. Experimental results on several real datasets demonstrate the advantages of the proposed framework. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2358 / 2366
页数:9
相关论文
共 50 条
  • [1] A latent variable model based on local preservation
    Wang, Xiu-Mei
    Gao, Xin-Bo
    Zhang, Qian-Kun
    Song, Guo-Xiang
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2010, 23 (03): : 369 - 375
  • [2] A latent variable model of segregation analysis for ordinal traits
    Zhang, HP
    Feng, R
    Zhu, HT
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2003, 98 (464) : 1023 - 1034
  • [3] Analysis of crop lodging using a latent variable model
    Allcroft, DJ
    Glasbey, CA
    JOURNAL OF AGRICULTURAL SCIENCE, 2003, 140 : 383 - 393
  • [4] Supervised latent linear Gaussian process latent variable model based classification
    Hou, Zhisong
    Feng, Qigao
    Zuo, Xiangang
    Journal of Computational Information Systems, 2013, 9 (13): : 5085 - 5092
  • [5] A Constrained Latent Variable Model
    Varol, Aydin
    Salzmann, Mathieu
    Fua, Pascal
    Urtasun, Raquel
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 2248 - 2255
  • [6] Robust Vision-Based Workout Analysis Using Diversified Deep Latent Variable Model
    Xiong, Hao
    Berkovsky, Shlomo
    Sharan, Roneel, V
    Liu, Sidong
    Coiera, Enrico
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 2155 - 2158
  • [7] Parking choice behaviour analysis of rural residents based on the latent variable random forest model
    Minqing Zhu
    Bo Zhao
    Hongjun Cui
    Sheng Yao
    Feng Xu
    Transportation Safety and Environment, 2024, 6 (03) : 170 - 183
  • [8] Parking choice behaviour analysis of rural residents based on the latent variable random forest model
    Zhu, Minqing
    Zhao, Bo
    Cui, Hongjun
    Yao, Sheng
    Xu, Feng
    TRANSPORTATION SAFETY AND ENVIRONMENT, 2024, 6 (03):
  • [9] An Adaptive Divergence-Based Non-Negative Latent Factor Model
    Yuan, Ye
    Wang, Renfang
    Yuan, Guangxiao
    Xin, Luo
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (10): : 6475 - 6487
  • [10] Non-Negative Latent Factor Model Based on β-Divergence for Recommender Systems
    Xin, Luo
    Yuan, Ye
    Zhou, MengChu
    Liu, Zhigang
    Shang, Mingsheng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (08): : 4612 - 4623