Self-Supervised Time Series Clustering With Model-Based Dynamics

被引:14
|
作者
Ma, Qianli [1 ,2 ,3 ]
Li, Sen [1 ]
Zhuang, Wanqing [1 ]
Wang, Jiabing [1 ]
Zeng, Delu [4 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Guangdong Prov Key Lab Computat Intelligence & Cy, Guangzhou 510006, Peoples R China
[3] South China Univ Technol, Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510006, Peoples R China
[4] South China Univ Technol, Sch Math, Guangzhou 510640, Peoples R China
基金
中国国家自然科学基金;
关键词
Time series analysis; Feature extraction; Task analysis; Hidden Markov models; Clustering algorithms; Predictive models; Heuristic algorithms; Model-based dynamics; recurrent neural networks (RNNs); self-supervised learning; time series clustering; unsupervised learning;
D O I
10.1109/TNNLS.2020.3016291
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series clustering is usually an essential unsupervised task in cases when category information is not available and has a wide range of applications. However, existing time series clustering methods usually either ignore temporal dynamics of time series or isolate the feature extraction from clustering tasks without considering the interaction between them. In this article, a time series clustering framework named self-supervised time series clustering network (STCN) is proposed to optimize the feature extraction and clustering simultaneously. In the feature extraction module, a recurrent neural network (RNN) conducts a one-step time series prediction that acts as the reconstruction of the input data, capturing the temporal dynamics and maintaining the local structures of the time series. The parameters of the output layer of the RNN are regarded as model-based dynamic features and then fed into a self-supervised clustering module to obtain the predicted labels. To bridge the gap between these two modules, we employ spectral analysis to constrain the similar features to have the same pseudoclass labels and align the predicted labels with pseudolabels as well. STCN is trained by iteratively updating the model parameters and the pseudoclass labels. Experiments conducted on extensive time series data sets show that STCN has state-of-the-art performance, and the visualization analysis also demonstrates the effectiveness of the proposed model.
引用
收藏
页码:3942 / 3955
页数:14
相关论文
共 50 条
  • [21] Self-supervised autoencoders for clustering and classification
    Nousi, Paraskevi
    Tefas, Anastasios
    EVOLVING SYSTEMS, 2020, 11 (03) : 453 - 466
  • [22] Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency
    Queen, Owen
    Hartvigsen, Thomas
    Koker, Teddy
    He, Huan
    Tsiligkaridis, Theodoros
    Zitnik, Marinka
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [23] Self-Supervised Autoregressive Domain Adaptation for Time Series Data
    Ragab, Mohamed
    Eldele, Emadeldeen
    Chen, Zhenghua
    Wu, Min
    Kwoh, Chee-Keong
    Li, Xiaoli
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 1341 - 1351
  • [24] Self-Supervised Pre-training for Time Series Classification
    Shi, Pengxiang
    Ye, Wenwen
    Qin, Zheng
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [25] TransEHR: Self-Supervised Transformer for Clinical Time Series Data
    Xu, Yanbo
    Xu, Shangqing
    Ramprassad, Manav
    Tumanov, Alexey
    Zhang, Chao
    MACHINE LEARNING FOR HEALTH, ML4H, VOL 225, 2023, 225 : 623 - 635
  • [26] Model-based 3D Hand Reconstruction via Self-Supervised Learning
    Chen, Yujin
    Tu, Zhigang
    Kang, Di
    Bao, Linchao
    Zhang, Ying
    Zhe, Xuefei
    Chen, Ruizhi
    Yuan, Junsong
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10446 - 10455
  • [27] Self-Supervised Clustering Models Based on BYOL Network Structure
    Chen, Xuehao
    Zhou, Jin
    Chen, Yuehui
    Han, Shiyuan
    Wang, Yingxu
    Du, Tao
    Yang, Cheng
    Liu, Bowen
    ELECTRONICS, 2023, 12 (23)
  • [28] Model-Based clustering for cross-sectional time series data
    H. Holly Wang
    Hao Zhang
    Journal of Agricultural, Biological, and Environmental Statistics, 2002, 7 : 107 - 127
  • [29] Model-based Clustering of Categorical Time Series with Multinomial Logit Classification
    Fruehwirth-Schnatter, Sylvia
    Pamminger, Christoph
    Winter-Ebmer, Rudolf
    Weber, Andrea
    NUMERICAL ANALYSIS AND APPLIED MATHEMATICS, VOLS I-III, 2010, 1281 : 1897 - +
  • [30] Approximate clustering of time series using compact model-based descriptions
    Kriegel, Hans-Peter
    Kroeger, Peer
    Pryakhin, Alexey
    Renz, Matthias
    Zherdin, Andrew
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, 2008, 4947 : 364 - 379