From research to applications - examples of operational ensemble post-processing in France using machine learning

被引:31
|
作者
Taillardat, Maxime [1 ,2 ]
Mestre, Olivier [1 ,2 ]
机构
[1] Meteo France, Toulouse, France
[2] CNRM UMR 3589, Toulouse, France
关键词
REGRESSION FORESTS; FORECAST FIELDS; SCHAAKE SHUFFLE; SCATTERED DATA; PRECIPITATION; TEMPERATURE; INTERPOLATION; MODELS; PREDICTION; OUTPUT;
D O I
10.5194/npg-27-329-2020
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Statistical post-processing of ensemble forecasts, from simple linear regressions to more sophisticated techniques, is now a well-known procedure for correcting biased and poorly dispersed ensemble weather predictions. However, practical applications in national weather services are still in their infancy compared to deterministic post-processing. This paper presents two different applications of ensemble post-processing using machine learning at an industrial scale. The first is a station-based post-processing of surface temperature and subsequent interpolation to a grid in a medium-resolution ensemble system. The second is a gridded post-processing of hourly rainfall amounts in a high-resolution ensemble prediction system. The techniques used rely on quantile regression forests (QRFs) and ensemble copula coupling (ECC), chosen for their robustness and simplicity of training regardless of the variable subject to calibration. Moreover, some variants of classical techniques used, such as QRF and ECC, were developed in order to adjust to operational constraints. A forecast anomaly-based QRF is used for temperature for a better prediction of cold and heat waves. A variant of ECC for hourly rainfall was built, accounting for more realistic longer rainfall accumulations. We show that both forecast quality and forecast value are improved compared to the raw ensemble. Finally, comments about model size and computation time are made.
引用
收藏
页码:329 / 347
页数:19
相关论文
共 50 条
  • [1] Performance evaluation and verification of post-processing methods for TIGGE ensemble data using machine learning approaches
    Patel, Anant
    Yadav, S. M.
    JOURNAL OF WATER AND CLIMATE CHANGE, 2024, 15 (04) : 1729 - 1749
  • [2] CONSULTANT-2 - PRE-PROCESSING AND POST-PROCESSING OF MACHINE LEARNING APPLICATIONS
    SLEEMAN, D
    RISSAKIS, M
    CRAW, S
    GRANER, N
    SHARMA, S
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 1995, 43 (01) : 43 - 63
  • [3] Deep learning for post-processing ensemble weather forecasts
    Gronquist, Peter
    Yao, Chengyuan
    Ben-Nun, Tal
    Dryden, Nikoli
    Dueben, Peter
    Li, Shigang
    Hoefler, Torsten
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2021, 379 (2194):
  • [4] Consultant-2: Pre- and post-processing of Machine Learning applications
    Univ of Aberdeen, Aberdeen, United Kingdom
    Int J Hum Comput Stud, 1 (43-63):
  • [5] Post-processing of global horizontal irradiance forecasts using machine learning
    Soos, Viktoria
    Mayer, Martin Janos
    9TH INTERNATIONAL YOUTH CONFERENCE ON ENERGY, IYCE 2024, 2024,
  • [6] Statcasting: A Machine Learning based Methodology for post-Processing Ensemble Predictions of Direct Normal Solar Irradiance
    Gaston, Martin
    Peruchena, Carlos F.
    Bernardos, Ana
    Luis Casado, Jose
    INTERNATIONAL CONFERENCE ON CONCENTRATING SOLAR POWER AND CHEMICAL ENERGY SYSTEMS (SOLARPACES 2017), 2018, 2033
  • [7] Application of weather post-processing methods for operational ensemble hydrological forecasting on multiple catchments in Canada
    Andrade, Freya Saima Aguilar
    Arsenault, Richard
    Poulin, Annie
    Troin, Magali
    Armstrong, William
    JOURNAL OF HYDROLOGY, 2024, 642
  • [8] POST-PROCESSING AND DIMENSIONALITY REDUCTION FOR EXTREME LEARNING MACHINE IN TEXT CLASSIFICATION
    Trusca, Maria Mihaela
    Aldea, Anamaria
    Gradinaru, Simona Elena
    Albu, Crisan
    ECONOMIC COMPUTATION AND ECONOMIC CYBERNETICS STUDIES AND RESEARCH, 2021, 55 (04): : 37 - 50
  • [9] A machine learning forensics technique to detect post-processing in digital videos
    Sandoval Orozco, Ana Lucila
    Quinto Huaman, Carlos
    Povedano Alvarez, Daniel
    Garcia Villalba, Luis Javier
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 111 : 199 - 212
  • [10] Post-processing automatic transcriptions with machine learning for verbal fluency scoring
    Bushnell, Justin
    Unverzagt, Frederick
    Wadley, Virginia G.
    Kennedy, Richard
    Del Gaizo, John
    Clark, David Glenn
    SPEECH COMMUNICATION, 2023, 155