New Techniques to Perform Cross-Validation for Time Series Models

被引:0
|
作者
Vamsikrishna A. [1 ]
Gijo E.V. [2 ]
机构
[1] Symbiosis Statistical Institute, Symbiosis International (Deemed University), Pune
[2] OR Unit, Indian Statistical Institute, Bangalore
关键词
Cross-validation; Exponential Smoothing; Model Evaluation Metrics; Time-series Modelling;
D O I
10.1007/s43069-024-00334-8
中图分类号
学科分类号
摘要
Model validation for time series models has always been a challenge due to a lot of complexities. The presence of auto-correlation in the data creates a challenge to the conventional cross validation techniques like k-fold cross validation to be implemented for time-series models. In this paper, two weighted k-fold time series split cross-validation techniques are proposed for this purpose. The proposed techniques were validated using the opening price data of cryptocurrency. Mean squared error (MSE), Mean absolute error (MAE) and Mean absolute percentage error (MAPE) were the selected metrics to validate the proposed techniques. Both the techniques were found to give robust results; however, the Exponential weighted K-fold time series split cross validation (EWKCV) technique was seen to perform better than Generally weighted K-fold time series split cross validation (GWKCV) technique. The results of the proposed techniques, along with the results of simple train-test split for the time-series models, is seen to give better result. © The Author(s), under exclusive licence to Springer Nature Switzerland AG 2024.
引用
收藏
相关论文
共 50 条
  • [21] Procrustes cross-validation of multivariate regression models
    Kucheryavskiy, Sergey
    Rodionova, Oxana
    Pomerantsev, Alexey
    ANALYTICA CHIMICA ACTA, 2023, 1255
  • [22] CROSS-VALIDATION IN STATISTICAL CLIMATE FORECAST MODELS
    MICHAELSEN, J
    JOURNAL OF CLIMATE AND APPLIED METEOROLOGY, 1987, 26 (11): : 1589 - 1600
  • [23] Cross-validation for nonlinear mixed effects models
    Emily Colby
    Eric Bair
    Journal of Pharmacokinetics and Pharmacodynamics, 2013, 40 : 243 - 252
  • [24] CROSS-VALIDATION PERFORMANCE OF MORTALITY PREDICTION MODELS
    HADORN, DC
    DRAPER, D
    ROGERS, WH
    KEELER, EB
    BROOK, RH
    STATISTICS IN MEDICINE, 1992, 11 (04) : 475 - 489
  • [25] Statistical Tests for Cross-Validation of Kriging Models
    Kleijnen, Jack P. C.
    van Beers, Wim C. M.
    INFORMS JOURNAL ON COMPUTING, 2022, 34 (01) : 607 - 621
  • [26] Parameterized cross-validation for nonlinear regression models
    Koo, Imhoi
    Lee, Namgil
    Kil, Rhee Man
    NEUROCOMPUTING, 2008, 71 (16-18) : 3089 - 3095
  • [28] A COMPARISON OF CROSS-VALIDATION TECHNIQUES IN DENSITY-ESTIMATION
    MARRON, JS
    ANNALS OF STATISTICS, 1987, 15 (01): : 152 - 162
  • [29] AUTOMATED KERNEL SMOOTHING OF DEPENDENT DATA BY USING TIME-SERIES CROSS-VALIDATION
    HART, JD
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1994, 56 (03): : 529 - 542
  • [30] Enhanced Cross-Validation Methods Leveraging Clustering Techniques
    Yucelbas, Cuneyt
    Yucelbas, Sule
    TRAITEMENT DU SIGNAL, 2023, 40 (06) : 2649 - 2660