Robust unsupervised image categorization based on variational autoencoder with disentangled latent representations

被引:5
|
作者
Yang, Lin [1 ]
Fan, Wentao [1 ]
Bouguila, Nizar [2 ]
机构
[1] Huaqiao Univ, Dept Comp Sci & Technol, Xiamen, Peoples R China
[2] Concordia Univ, Concordia Inst Informat Syst Engn CIISE, Montreal, PQ, Canada
基金
中国国家自然科学基金;
关键词
Clustering; Variational autoencoder (VAE); Disentangled latent representations; Robust training; Mixture model; Student's-t distribution;
D O I
10.1016/j.knosys.2022.108671
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, deep generative models have been successfully applied to unsupervised clustering analyses, due to the model capabilities for learning good representations of the input data from a lower dimensional latent space. In this work, we propose a robust deep generative clustering method based on a variational autoencoder (VAE) for unsupervised image categorization. The merits of our method can be summarized as follows. First, each latent representation generated by the encoder is disentangled into the cluster representation and generation representation, where the cluster representation is responsible for preserving the clustering information, while the generation representation is responsible for conserving the generation information. Thus, by only utilizing the cluster representation, we can improve the performance and efficiency of clustering tasks without interference from generating tasks. Second, a Student's-t mixture model is adopted as the prior over the cluster representation to enhance the robustness of our method against clustering outliers. Third, we propose a biaugmentation module to promote the training stability for our model. In contrast with most of the existing deep generative clustering methods that require a pretraining step to stabilize the training process, our model is able to provide a stable training process through feature disentanglement and data augmentation. We validate the proposed robust deep generative clustering method through extensive experiments by comparing it with state-of-the-art methods on unsupervised image categorization. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] CLINICALLY RELEVANT LATENT SPACE EMBEDDING OF CANCER HISTOPATHOLOGY SLIDES THROUGH VARIATIONAL AUTOENCODER BASED IMAGE COMPRESSION
    Nasr, Mohammad Sadegh
    Hajighasemi, Amir
    Koomey, Paul
    Malidarreh, Parisa Boodaghi
    Robben, Michael
    Saurav, Jillur Rahman
    Shang, Helen H.
    Huber, Manfred
    Luber, Jacob M.
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [32] Unsupervised remote sensing image segmentation based on a dual autoencoder
    Zhang, Ruonan
    Yu, Long
    Tian, Shengwei
    Lv, Yalong
    JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (03)
  • [33] Unsupervised machinery prognostics approach based on wavelet packet decomposition and variational autoencoder
    Leonardo Franco de Godói
    Eurípedes Guilherme de Oliveira Nóbrega
    Journal of the Brazilian Society of Mechanical Sciences and Engineering, 2024, 46
  • [34] Unsupervised machinery prognostics approach based on wavelet packet decomposition and variational autoencoder
    de Godoi, Leonardo Franco
    Nobrega, Euripedes Guilherme de Oliveira
    JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING, 2024, 46 (02)
  • [35] Source Separation in Joint Communication and Radar Systems Based on Unsupervised Variational Autoencoder
    Alaghbari, Khaled A.
    Lim, Heng Siong
    Jin, Benzhou
    Shen, Yutong
    IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2024, 5 : 56 - 70
  • [36] Latent representation learning based autoencoder for unsupervised feature selection in hyperspectral imagery
    Wang, Xinxin
    Wang, Zhenyu
    Zhang, Yongshan
    Jiang, Xinwei
    Cal, Zhihua
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (09) : 12061 - 12075
  • [37] Latent representation learning based autoencoder for unsupervised feature selection in hyperspectral imagery
    Xinxin Wang
    Zhenyu Wang
    Yongshan Zhang
    Xinwei Jiang
    Zhihua Cai
    Multimedia Tools and Applications, 2022, 81 : 12061 - 12075
  • [38] DISENTANGLED SPEECH REPRESENTATION LEARNING BASED ON FACTORIZED HIERARCHICAL VARIATIONAL AUTOENCODER WITH SELF-SUPERVISED OBJECTIVE
    Xie, Yuying
    Arildsen, Thomas
    Tan, Zheng-Hua
    2021 IEEE 31ST INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2021,
  • [39] Synthetic Aperture Radar Image Compression Based on a Variational Autoencoder
    Xu, Qihan
    Xiang, Yunfan
    Di, Zhixiong
    Fan, Yibo
    Feng, Quanyuan
    Wu, Qiang
    Shi, Jiangyi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [40] Image Augmentation based on Variational Autoencoder for Breast Tumor Segmentation
    Balaji, K.
    ACADEMIC RADIOLOGY, 2023, 30 : S172 - S183