Robust unsupervised image categorization based on variational autoencoder with disentangled latent representations

被引:5
|
作者
Yang, Lin [1 ]
Fan, Wentao [1 ]
Bouguila, Nizar [2 ]
机构
[1] Huaqiao Univ, Dept Comp Sci & Technol, Xiamen, Peoples R China
[2] Concordia Univ, Concordia Inst Informat Syst Engn CIISE, Montreal, PQ, Canada
基金
中国国家自然科学基金;
关键词
Clustering; Variational autoencoder (VAE); Disentangled latent representations; Robust training; Mixture model; Student's-t distribution;
D O I
10.1016/j.knosys.2022.108671
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, deep generative models have been successfully applied to unsupervised clustering analyses, due to the model capabilities for learning good representations of the input data from a lower dimensional latent space. In this work, we propose a robust deep generative clustering method based on a variational autoencoder (VAE) for unsupervised image categorization. The merits of our method can be summarized as follows. First, each latent representation generated by the encoder is disentangled into the cluster representation and generation representation, where the cluster representation is responsible for preserving the clustering information, while the generation representation is responsible for conserving the generation information. Thus, by only utilizing the cluster representation, we can improve the performance and efficiency of clustering tasks without interference from generating tasks. Second, a Student's-t mixture model is adopted as the prior over the cluster representation to enhance the robustness of our method against clustering outliers. Third, we propose a biaugmentation module to promote the training stability for our model. In contrast with most of the existing deep generative clustering methods that require a pretraining step to stabilize the training process, our model is able to provide a stable training process through feature disentanglement and data augmentation. We validate the proposed robust deep generative clustering method through extensive experiments by comparing it with state-of-the-art methods on unsupervised image categorization. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Variational AutoEncoder for Reference based Image Super-Resolution
    Liu, Zhi-Song
    Siu, Wan-Chi
    Wang, Li-Wen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 516 - 525
  • [42] Just-in-time framework for robust soft sensing based on robust variational autoencoder
    Guo, Fan
    Liu, Kun
    Huang, Biao
    JOURNAL OF PROCESS CONTROL, 2024, 143
  • [43] Variational Autoencoder-Based Vehicle Trajectory Prediction with an Interpretable Latent Space
    Neumeier, Marion
    Tollkuhn, Andreas
    Berberich, Thomas
    Botsch, Michael
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 820 - 827
  • [44] Variational Autoencoder based Latent Factor Decoding of Multichannel EEG for Emotion Recognition
    Li, Xiang
    Zhao, Zhigang
    Song, Dawei
    Zhang, Yazhou
    Niu, Chunyang
    Zhang, Junwei
    Huo, Jidong
    Li, Jing
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 684 - 687
  • [45] A ROBUST SPEAKER CLUSTERING METHOD BASED ON DISCRETE TIED VARIATIONAL AUTOENCODER
    Feng, Chen
    Wang, Jianzong
    Li, Tongxu
    Peng, Junqing
    Xiao, Jing
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 6024 - 6028
  • [46] Data Augmentation in Latent Space with Variational Autoencoder and Pretrained Image Model for Visual Reinforcement Learning
    Dang, Xuzhe
    Edelkamp, Stefan
    KI 2024: ADVANCES IN ARTIFICIAL INTELLIGENCE, KI 2024, 2024, 14992 : 45 - 59
  • [47] Photonic unsupervised learning variational autoencoder for high-throughput and low-latency image transmission
    Chen, Yitong
    Zhou, Tiankuang
    Wu, Jiamin
    Qiao, Hui
    Lin, Xing
    Fang, Lu
    Dai, Qionghai
    SCIENCE ADVANCES, 2023, 9 (07)
  • [48] Unsupervised feature learning for online voltage stability evaluation and monitoring based on variational autoencoder
    Yang, Haosen
    Qiu, Robert C.
    Shi, Xin
    He, Xing
    ELECTRIC POWER SYSTEMS RESEARCH, 2020, 182
  • [49] 3D CAD model retrieval based on sketch and unsupervised variational autoencoder
    Qin, Feiwei
    Qiu, Shi
    Gao, Shuming
    Bai, Jing
    ADVANCED ENGINEERING INFORMATICS, 2022, 51
  • [50] A deep-learning-based unsupervised model on esophageal manometry using variational autoencoder
    Kou, Wenjun
    Carlson, Dustin A.
    Baumann, Alexandra J.
    Donnan, Erica
    Luo, Yuan
    Pandolfino, John E.
    Etemadi, Mozziyar
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2021, 112