Multi-modal and multi-scale temporal metric learning for a robust time series nearest neighbors classification

被引:9
|
作者
Do, Cao-Tri [1 ,2 ,3 ]
Douzal-Chouakria, Ahlame [1 ]
Marie, Sylvain [3 ]
Rombaut, Michele [2 ]
Varasteh, Saeed [1 ]
机构
[1] Univ Grenoble Alpes, Grenoble INP, CNRS, LIG, F-38000 Grenoble, France
[2] Univ Grenoble Alpes, GIPSA Lab, Grenoble, France
[3] Schneider Elect, Eybens, France
关键词
Metric learning; Time series; Classification; kNN; Svm; Dissimilarity space; Multi-modal metric; Multi-scale metric; EDIT DISTANCE; KERNEL; TRANSFORMATION;
D O I
10.1016/j.ins.2017.08.020
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The definition of a metric between time series is inherent to several data analysis and mining tasks, including clustering, classification or forecasting. Time series data present naturally several modalities covering their amplitude, behavior or frequential spectrum, that may be expressed with varying delays and at multiple temporal scales exhibited globally or locally. Combining several modalities at multiple temporal scales to learn a holistic metric is a key challenge for many real temporal data applications. This paper proposes a Multi-modal and Multi-scale Temporal Metric Learning ((MTML)-T-2) approach for a robust time series nearest neighbors classification. The solution lies in embedding time series into a dissimilarity space where a pairwise SVM is used to learn both linear and non linear combined metric. A sparse and interpretable variant of the solution shows the ability of the learned temporal metric to localize accurately discriminative modalities as well as their temporal scales. A wide range of 30 public and challenging datasets, encompassing images, traces and ECG data, are used to show the efficiency and the potential of (MTML)-T-2 for an effective time series nearest neighbors classification. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:272 / 285
页数:14
相关论文
共 50 条
  • [21] The power of correlative microscopy: multi-modal, multi-scale, multi-dimensional
    Caplan, Jeffrey
    Niethammer, Marc
    Taylor, Russell M., II
    Czymmek, Kirk J.
    CURRENT OPINION IN STRUCTURAL BIOLOGY, 2011, 21 (05) : 686 - 693
  • [22] Attention-Aided Generative Learning for Multi-Scale Multi-Modal Fundus Image Translation
    Pham, Van-Nguyen
    Le, Duc-Tai
    Bum, Junghyun
    Lee, Eun Jung
    Han, Jong Chul
    Choo, Hyunseung
    IEEE ACCESS, 2023, 11 : 51701 - 51711
  • [23] Robust indoor localization based on multi-modal information fusion and multi-scale sequential feature extraction
    Wang, Qinghu
    Jia, Jie
    Chen, Jian
    Deng, Yansha
    Wang, Xingwei
    Aghvami, Abdol Hamid
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 155 : 164 - 178
  • [24] Multi-modal Multi-scale Speech Expression Evaluation in Computer-Assisted Language Learning
    Li, Jingbei
    Wu, Zhiyong
    Li, Runnan
    Xu, Mingxing
    Lei, Kehua
    Cai, Lianhong
    ARTIFICIAL INTELLIGENCE AND MOBILE SERVICES - AIMS 2018, 2018, 10970 : 16 - 28
  • [25] Multi-Modal and Multi-Scale Temporal Fusion Architecture Search for Audio-Visual Video Parsing
    Zhang, Jiayi
    Li, Weixin
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3328 - 3336
  • [26] Decoding human brain functions: Multi-modal, multi-scale insights
    Erichsen, Camilla T.
    Li, Deying
    Fan, Lingzhong
    INNOVATION, 2024, 5 (01):
  • [27] Multi-scale relation reasoning for multi-modal Visual Question Answering
    Wu, Yirui
    Ma, Yuntao
    Wan, Shaohua
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 96
  • [28] Large Margin Multi-Modal Triplet Metric Learning
    Di, Xing
    Patel, Vishal M.
    2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 370 - 377
  • [29] Efficient multi-modal geometric mean metric learning
    Liang, Jianqing
    Hu, Qinghua
    Zhu, Pengfei
    Wang, Wenwu
    PATTERN RECOGNITION, 2018, 75 : 188 - 198
  • [30] Multi-scale and multi-modal GIS-T data model
    Chen, Shaopei
    Tan, Jianjun
    Claramunt, Christophe
    Ray, Cyril
    JOURNAL OF TRANSPORT GEOGRAPHY, 2011, 19 (01) : 147 - 161