Self-Supervised Time Series Clustering With Model-Based Dynamics

被引:14
|
作者
Ma, Qianli [1 ,2 ,3 ]
Li, Sen [1 ]
Zhuang, Wanqing [1 ]
Wang, Jiabing [1 ]
Zeng, Delu [4 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Guangdong Prov Key Lab Computat Intelligence & Cy, Guangzhou 510006, Peoples R China
[3] South China Univ Technol, Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510006, Peoples R China
[4] South China Univ Technol, Sch Math, Guangzhou 510640, Peoples R China
基金
中国国家自然科学基金;
关键词
Time series analysis; Feature extraction; Task analysis; Hidden Markov models; Clustering algorithms; Predictive models; Heuristic algorithms; Model-based dynamics; recurrent neural networks (RNNs); self-supervised learning; time series clustering; unsupervised learning;
D O I
10.1109/TNNLS.2020.3016291
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series clustering is usually an essential unsupervised task in cases when category information is not available and has a wide range of applications. However, existing time series clustering methods usually either ignore temporal dynamics of time series or isolate the feature extraction from clustering tasks without considering the interaction between them. In this article, a time series clustering framework named self-supervised time series clustering network (STCN) is proposed to optimize the feature extraction and clustering simultaneously. In the feature extraction module, a recurrent neural network (RNN) conducts a one-step time series prediction that acts as the reconstruction of the input data, capturing the temporal dynamics and maintaining the local structures of the time series. The parameters of the output layer of the RNN are regarded as model-based dynamic features and then fed into a self-supervised clustering module to obtain the predicted labels. To bridge the gap between these two modules, we employ spectral analysis to constrain the similar features to have the same pseudoclass labels and align the predicted labels with pseudolabels as well. STCN is trained by iteratively updating the model parameters and the pseudoclass labels. Experiments conducted on extensive time series data sets show that STCN has state-of-the-art performance, and the visualization analysis also demonstrates the effectiveness of the proposed model.
引用
收藏
页码:3942 / 3955
页数:14
相关论文
共 50 条
  • [41] Fast Self-Supervised Clustering With Anchor Graph
    Wang, Jingyu
    Ma, Zhenyu
    Nie, Feiping
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) : 4199 - 4212
  • [42] SCGC : Self-supervised contrastive graph clustering
    Kulatilleke, Gayan K.
    Portmann, Marius
    Chandra, Shekhar S.
    NEUROCOMPUTING, 2025, 611
  • [43] Semi-supervised projected model-based clustering
    Guerra, Luis
    Bielza, Concha
    Robles, Victor
    Larranaga, Pedro
    DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 28 (04) : 882 - 917
  • [44] Semi-supervised projected model-based clustering
    Luis Guerra
    Concha Bielza
    Víctor Robles
    Pedro Larrañaga
    Data Mining and Knowledge Discovery, 2014, 28 : 882 - 917
  • [45] Rethinking self-supervised learning for time series forecasting: A temporal perspective
    Zhao, Shubao
    Zhou, Xinxing
    Jin, Ming
    Hou, Zhaoxiang
    Yang, Chengyi
    Li, Zengxiang
    Wen, Qingsong
    Wang, Yi
    Wen, Yanlong
    Yuan, Xiaojie
    KNOWLEDGE-BASED SYSTEMS, 2024, 305
  • [46] Self-Supervised Anomaly Detection Using Outliers for Multivariate Time Series
    Hong, Jaehyeop
    Hur, Youngbum
    IEEE ACCESS, 2024, 12 : 197516 - 197528
  • [47] Water leak detection using self-supervised time series classification
    Blazquez-Garcia, Ane
    Conde, Angel
    Mori, Usue
    Lozano, Jose A.
    INFORMATION SCIENCES, 2021, 574 : 528 - 541
  • [48] Water leak detection using self-supervised time series classification
    Blázquez-García, Ane
    Conde, Angel
    Mori, Usue
    Lozano, Jose A.
    Information Sciences, 2021, 574 : 528 - 541
  • [49] SimEXT: Self-supervised Representation Learning for Extreme Values in Time Series
    Galib, Asadullah Hill
    Tan, Pang-Ning
    Luo, Lifeng
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1031 - 1036
  • [50] Self-Supervised Time-Series Preprocessing Framework for Maritime Applications
    Dong, Shengli
    Liu, Jilong
    Han, Bing
    Wang, Shengzheng
    Zeng, Hong
    Zhang, Meng
    ELECTRONICS, 2025, 14 (04):