Self-Supervised Time Series Clustering With Model-Based Dynamics

被引:14
|
作者
Ma, Qianli [1 ,2 ,3 ]
Li, Sen [1 ]
Zhuang, Wanqing [1 ]
Wang, Jiabing [1 ]
Zeng, Delu [4 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Guangdong Prov Key Lab Computat Intelligence & Cy, Guangzhou 510006, Peoples R China
[3] South China Univ Technol, Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510006, Peoples R China
[4] South China Univ Technol, Sch Math, Guangzhou 510640, Peoples R China
基金
中国国家自然科学基金;
关键词
Time series analysis; Feature extraction; Task analysis; Hidden Markov models; Clustering algorithms; Predictive models; Heuristic algorithms; Model-based dynamics; recurrent neural networks (RNNs); self-supervised learning; time series clustering; unsupervised learning;
D O I
10.1109/TNNLS.2020.3016291
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series clustering is usually an essential unsupervised task in cases when category information is not available and has a wide range of applications. However, existing time series clustering methods usually either ignore temporal dynamics of time series or isolate the feature extraction from clustering tasks without considering the interaction between them. In this article, a time series clustering framework named self-supervised time series clustering network (STCN) is proposed to optimize the feature extraction and clustering simultaneously. In the feature extraction module, a recurrent neural network (RNN) conducts a one-step time series prediction that acts as the reconstruction of the input data, capturing the temporal dynamics and maintaining the local structures of the time series. The parameters of the output layer of the RNN are regarded as model-based dynamic features and then fed into a self-supervised clustering module to obtain the predicted labels. To bridge the gap between these two modules, we employ spectral analysis to constrain the similar features to have the same pseudoclass labels and align the predicted labels with pseudolabels as well. STCN is trained by iteratively updating the model parameters and the pseudoclass labels. Experiments conducted on extensive time series data sets show that STCN has state-of-the-art performance, and the visualization analysis also demonstrates the effectiveness of the proposed model.
引用
收藏
页码:3942 / 3955
页数:14
相关论文
共 50 条
  • [1] Self-supervised Classification of Clinical Multivariate Time Series using Time Series Dynamics
    Yehuda, Yakir
    Freedman, Daniel
    Radinsky, Kira
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 5416 - 5427
  • [2] Semi-supervised Time Series Classification Model with Self-supervised Learning
    Xi, Liang
    Yun, Zichao
    Liu, Han
    Wang, Ruidong
    Huang, Xunhua
    Fan, Haoyi
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
  • [3] Model-based clustering of multiple time series
    Fruehwirth-Schnatter, Sylvia
    Kaufmann, Sylvia
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2008, 26 (01) : 78 - 89
  • [4] Model-based Clustering of Categorical Time Series
    Pamminger, Christoph
    Fruehwirth-Schnatter, Sylvia
    BAYESIAN ANALYSIS, 2010, 5 (02): : 345 - 368
  • [5] Self-Supervised Framework Based on Subject-Wise Clustering for Human Subject Time Series Data
    Seong, Eunseon
    Lee, Harim
    Chae, Dong-Kyu
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 20, 2024, : 22341 - 22349
  • [6] Contrastive learning based self-supervised time-series analysis
    Poppelbaum, Johannes
    Chadha, Gavneet Singh
    Schwung, Andreas
    APPLIED SOFT COMPUTING, 2022, 117
  • [7] Self-Supervised Time Series Classification Based on LSTM and Contrastive Transformer
    ZOU Yuanhao
    ZHANG Yufei
    ZHAO Xiaodong
    Wuhan University Journal of Natural Sciences, 2022, 27 (06) : 521 - 530
  • [9] A Model-Based Multivariate Time Series Clustering Algorithm
    Zhou, Pei-Yuan
    Chan, Keith C. C.
    TRENDS AND APPLICATIONS IN KNOWLEDGE DISCOVERY AND DATA MINING, 2014, 8643 : 805 - 817
  • [10] Self-supervised Learning for Semi-supervised Time Series Classification
    Jawed, Shayan
    Grabocka, Josif
    Schmidt-Thieme, Lars
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 499 - 511