Self-Supervised Time Series Clustering With Model-Based Dynamics

被引:14
|
作者
Ma, Qianli [1 ,2 ,3 ]
Li, Sen [1 ]
Zhuang, Wanqing [1 ]
Wang, Jiabing [1 ]
Zeng, Delu [4 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Guangdong Prov Key Lab Computat Intelligence & Cy, Guangzhou 510006, Peoples R China
[3] South China Univ Technol, Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510006, Peoples R China
[4] South China Univ Technol, Sch Math, Guangzhou 510640, Peoples R China
基金
中国国家自然科学基金;
关键词
Time series analysis; Feature extraction; Task analysis; Hidden Markov models; Clustering algorithms; Predictive models; Heuristic algorithms; Model-based dynamics; recurrent neural networks (RNNs); self-supervised learning; time series clustering; unsupervised learning;
D O I
10.1109/TNNLS.2020.3016291
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series clustering is usually an essential unsupervised task in cases when category information is not available and has a wide range of applications. However, existing time series clustering methods usually either ignore temporal dynamics of time series or isolate the feature extraction from clustering tasks without considering the interaction between them. In this article, a time series clustering framework named self-supervised time series clustering network (STCN) is proposed to optimize the feature extraction and clustering simultaneously. In the feature extraction module, a recurrent neural network (RNN) conducts a one-step time series prediction that acts as the reconstruction of the input data, capturing the temporal dynamics and maintaining the local structures of the time series. The parameters of the output layer of the RNN are regarded as model-based dynamic features and then fed into a self-supervised clustering module to obtain the predicted labels. To bridge the gap between these two modules, we employ spectral analysis to constrain the similar features to have the same pseudoclass labels and align the predicted labels with pseudolabels as well. STCN is trained by iteratively updating the model parameters and the pseudoclass labels. Experiments conducted on extensive time series data sets show that STCN has state-of-the-art performance, and the visualization analysis also demonstrates the effectiveness of the proposed model.
引用
收藏
页码:3942 / 3955
页数:14
相关论文
共 50 条
  • [31] Panel data analysis: a survey on model-based clustering of time series
    Fruehwirth-Schnatter, Sylvia
    ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2011, 5 (04) : 251 - 280
  • [32] Model-based clustering for cross-sectional time series data
    Wang, HH
    Zhang, H
    JOURNAL OF AGRICULTURAL BIOLOGICAL AND ENVIRONMENTAL STATISTICS, 2002, 7 (01) : 107 - 127
  • [33] Model-based fuzzy time series clustering of conditional higher moments
    Cerqueti, Roy
    Giacalone, Massimiliano
    Mattera, Raffaele
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2021, 134 : 34 - 52
  • [34] Maximum Pseudolikelihood Estimation for Model-Based Clustering of Time Series Data
    Nguyen, Hien D.
    McLachlan, Geoffrey J.
    Orban, Pierre
    Bellec, Pierre
    Janke, Andrew L.
    NEURAL COMPUTATION, 2017, 29 (04) : 990 - 1020
  • [35] Panel data analysis: a survey on model-based clustering of time series
    Sylvia Frühwirth-Schnatter
    Advances in Data Analysis and Classification, 2011, 5 : 251 - 280
  • [36] Self-Supervised Clustering for Leaf Disease Identification
    Monowar, Muhammad Mostafa
    Hamid, Md. Abdul
    Kateb, Faris A.
    Ohi, Abu Quwsar
    Mridha, M. F.
    AGRICULTURE-BASEL, 2022, 12 (06):
  • [37] Differentiable self-supervised clustering with intrinsic interpretability
    Yan, Xiaoqiang
    Jin, Zhixiang
    Mao, Yiqiao
    Ye, Yangdong
    Yu, Hui
    NEURAL NETWORKS, 2024, 179
  • [38] Self-supervised spectral clustering with exemplar constraints
    Bai, Liang
    Zhao, Yunxiao
    Liang, Jiye
    PATTERN RECOGNITION, 2022, 132
  • [39] Self-Supervised Convolutional Subspace Clustering Network
    Zhang, Junjian
    Li, Chun-Guang
    You, Chong
    Qi, Xianbiao
    Zhang, Honggang
    Guo, Jun
    Lin, Zhouchen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5468 - 5477
  • [40] Self-Supervised Deep Multiview Spectral Clustering
    Zong, Linlin
    Miao, Faqiang
    Zhang, Xianchao
    Liang, Wenxin
    Xu, Bo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 4299 - 4308