New Techniques to Perform Cross-Validation for Time Series Models

被引:0
|
作者
Vamsikrishna A. [1 ]
Gijo E.V. [2 ]
机构
[1] Symbiosis Statistical Institute, Symbiosis International (Deemed University), Pune
[2] OR Unit, Indian Statistical Institute, Bangalore
关键词
Cross-validation; Exponential Smoothing; Model Evaluation Metrics; Time-series Modelling;
D O I
10.1007/s43069-024-00334-8
中图分类号
学科分类号
摘要
Model validation for time series models has always been a challenge due to a lot of complexities. The presence of auto-correlation in the data creates a challenge to the conventional cross validation techniques like k-fold cross validation to be implemented for time-series models. In this paper, two weighted k-fold time series split cross-validation techniques are proposed for this purpose. The proposed techniques were validated using the opening price data of cryptocurrency. Mean squared error (MSE), Mean absolute error (MAE) and Mean absolute percentage error (MAPE) were the selected metrics to validate the proposed techniques. Both the techniques were found to give robust results; however, the Exponential weighted K-fold time series split cross validation (EWKCV) technique was seen to perform better than Generally weighted K-fold time series split cross validation (GWKCV) technique. The results of the proposed techniques, along with the results of simple train-test split for the time-series models, is seen to give better result. © The Author(s), under exclusive licence to Springer Nature Switzerland AG 2024.
引用
收藏
相关论文
共 50 条
  • [1] A CROSS-VALIDATION FILTER FOR TIME-SERIES MODELS
    DEJONG, P
    BIOMETRIKA, 1988, 75 (03) : 594 - 600
  • [2] Using cross-validation methods to select time series models: Promises and pitfalls
    Liu, Siwei
    Zhou, Di Jody
    BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2024, 77 (02): : 337 - 355
  • [3] Markov cross-validation for time series model evaluations
    Jiang, Gaoxia
    Wang, Wenjian
    INFORMATION SCIENCES, 2017, 375 : 219 - 233
  • [4] On the use of cross-validation for time series predictor evaluation
    Bergmeir, Christoph
    Benitez, Jose M.
    INFORMATION SCIENCES, 2012, 191 : 192 - 213
  • [5] Approximate leave-future-out cross-validation for Bayesian time series models
    Burkner, Paul-Christian
    Gabry, Jonah
    Vehtari, Aki
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2020, : 2499 - 2523
  • [6] On cross-validation of Bayesian models
    Alqallaf, F
    Gustafson, P
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2001, 29 (02): : 333 - 340
  • [7] A Procedure for Identification of Appropriate State Space and ARIMA Models Based on Time-Series Cross-Validation
    Ramos, Patricia
    Oliveira, Jose Manuel
    ALGORITHMS, 2016, 9 (04):
  • [8] A note on the validity of cross-validation for evaluating autoregressive time series prediction
    Bergmeir, Christoph
    Hyndman, Rob J.
    Koo, Bonsoo
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2018, 120 : 70 - 83
  • [9] Optimal spline smoothing of fMRI time series by generalized cross-validation
    Carew, JD
    Wahba, G
    Xie, XH
    Nordheim, EV
    Meyerand, ME
    NEUROIMAGE, 2003, 18 (04) : 950 - 961
  • [10] Bayesian cross-validation of geostatistical models
    Lobo, Viviana G. R.
    Fonseca, Thais C. O.
    Moura, Fernando A. S.
    SPATIAL STATISTICS, 2020, 35