Earth System Model Evaluation Tool (ESMValTool) v2.0-an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP

被引:77
|
作者
Eyring, Veronika [1 ,2 ]
Bock, Lisa [1 ]
Lauer, Axel [1 ]
Righi, Mattia [1 ]
Schlund, Manuel [1 ]
Andela, Bouwe [3 ]
Arnone, Enrico [4 ,5 ]
Bellprat, Omar [6 ]
Broetz, Bjorn [1 ]
Caron, Louis-Philippe [6 ]
Carvalhais, Nuno [7 ,8 ]
Cionni, Irene [9 ]
Cortesi, Nicola [6 ]
Crezee, Bas [10 ]
Davin, Edouard L. [10 ]
Davini, Paolo [4 ]
Debeire, Kevin [1 ]
de Mora, Lee [11 ]
Deser, Clara [12 ]
Docquier, David [13 ]
Earnshaw, Paul [14 ]
Ehbrecht, Carsten [15 ]
Gier, Bettina K. [1 ,2 ]
Gonzalez-Reviriego, Nube [6 ]
Goodman, Paul [16 ]
Hagemann, Stefan [17 ]
Hardiman, Steven [14 ]
Hassler, Birgit [1 ]
Hunter, Alasdair [6 ]
Kadow, Christopher [15 ,18 ]
Kindermann, Stephan [15 ]
Koirala, Sujan [7 ]
Koldunov, Nikolay [19 ,20 ]
Lejeune, Quentin [10 ,21 ]
Lembo, Valerio [22 ]
Lovato, Tomas [23 ]
Lucarini, Valerio [22 ,24 ,25 ]
Massonnet, Francois [26 ]
Mueller, Benjamin [27 ]
Pandde, Amarjiit [16 ]
Perez-Zanon, Nuria [6 ]
Phillips, Adam [12 ]
Predoi, Valeriu [28 ]
Russell, Joellen [16 ]
Sellar, Alistair [14 ]
Serva, Federico [29 ]
Stacke, Tobias [17 ,30 ]
Swaminathan, Ranjini [31 ]
Torralba, Veronica [6 ]
Vegas-Regidor, Javier [6 ]
机构
[1] Deutsch Zentrum Luft & Raumfahrt, Inst Phys Atmosphere, Oberpfaffenhofen, Germany
[2] Univ Bremen, Inst Environm Phys IUP, Bremen, Germany
[3] Netherlands eSci Ctr, Sci Pk 140, NL-1098 XG Amsterdam, Netherlands
[4] Consiglio Nazl Ric ISAC CNR, Inst Atmospher Sci & Climate, Turin, Italy
[5] Univ Torino, Dept Phys, Turin, Italy
[6] Barcelona Supercomp Ctr BSC, Barcelona, Spain
[7] Max Planck Inst Biogeochem, Dept Biogeochem Integrat, Jena, Germany
[8] Univ Nova Lisboa, DCEA, FCT, P-2829516 Caparica, Portugal
[9] Agenzia Nazl Nuove Tecnol Energia & Sviluppo Econ, Rome, Italy
[10] Swiss Fed Inst Technol, Inst Atmospher & Climate Sci, Zurich, Switzerland
[11] Plymouth Marine Lab PML, Plymouth, Devon, England
[12] Natl Ctr Atmospher Res NCAR, Boulder, CO USA
[13] Swedish Meteorol & Hydrol Inst SMHI, Rossby Ctr, Norrkoping, Sweden
[14] Met Off, Exeter, Devon, England
[15] Deutsch Klimarechenzentrum, Hamburg, Germany
[16] Univ Arizona, Dept Geosci, Tucson, AZ 85721 USA
[17] Helmholtz Zentrum Geesthacht HZG, Inst Coastal Res, Geesthacht, Germany
[18] Freie Univ Berlin FUB, Berlin, Germany
[19] Ctr Marine Environm Sci, MARUM, Bremen, Germany
[20] Helmholtz Zentrum Polar & Meeresforsch, Alfred Wegener Inst, Bremerhaven, Germany
[21] Climate Analyt, Berlin, Germany
[22] Univ Hamburg, Meteorol Inst, CEN, Hamburg, Germany
[23] Fdn Ctr Euro Mediterraneo Cambiamenti Climat CMCC, Bologna, Italy
[24] Univ Reading, Dept Math & Stat, Reading, Berks, England
[25] Univ Reading, Ctr Math Planet Earth, Dept Math & Stat, Reading, Berks, England
[26] Catholic Univ Louvain, Earth & Life Inst, Georges Lemaitre Ctr Earth & Climate Res, Louvain La Neuve, Belgium
[27] Ludwig Maximilians Univ LMU, Dept Geog, Munich, Germany
[28] Univ Reading, NCAS Computat Modelling Serv CMS, Reading, Berks, England
[29] Consiglio Nazl Ric ISMAR CNR, Inst Marine Sci, Rome, Italy
[30] Max Planck Inst Meteorol MPI M, Hamburg, Germany
[31] Univ Reading, Dept Meteorol, Reading, Berks, England
[32] Politecn Torino, Dept Environm Land & Infrastruct Engn, Turin, Italy
基金
欧盟地平线“2020”;
关键词
LAND-COVER CHANGES; MIDLATITUDE ATMOSPHERIC VARIABILITY; GLOBAL CLIMATE MODEL; NORTH-ATLANTIC; COUPLED MODEL; VERSION; PART I; INTERNAL VARIABILITY; VEGETATION COVER; WEATHER REGIMES;
D O I
10.5194/gmd-13-3383-2020
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth system models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility. It consists of (1) an easy-to-install, well-documented Python package providing the core functionalities (ESMValCore) that performs common preprocessing operations and (2) a diagnostic part that includes tailored diagnostics and performance metrics for specific scientific applications. Here we describe large-scale diagnostics of the second major release of the tool that supports the evaluation of ESMs participating in CMIP Phase 6 (CMIP6). ESMValTool v2.0 includes a large collection of diagnostics and performance metrics for atmospheric, oceanic, and terrestrial variables for the mean state, trends, and variability. ESMValTool v2.0 also successfully reproduces figures from the evaluation and projections chapters of the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) and incorporates updates from targeted analysis packages, such as the NCAR Climate Variability Diagnostics Package for the evaluation of modes of variability, the Thermodynamic Diagnostic Tool (TheDiaTo) to evaluate the energetics of the climate system, as well as parts of AutoAssess that contains a mix of top-down performance metrics. The tool has been fully integrated into the Earth System Grid Federation (ESGF) infrastructure at the Deutsches Klimarechenzentrum (DKRZ) to provide evaluation results from CMIP6 model simulations shortly after the output is published to the CMIP archive. A result browser has been implemented that enables advanced monitoring of the evaluation results by a broad user community at much faster timescales than what was possible in CMIP5.
引用
收藏
页码:3383 / 3438
页数:56
相关论文
共 11 条
  • [1] Earth System Model Evaluation Tool (ESMValTool) v2.0-diagnostics for extreme events, regional and impact evaluation, and analysis of Earth system models in CMIP
    Weigel, Katja
    Bock, Lisa
    Gier, Bettina K.
    Lauer, Axel
    Righi, Mattia
    Schlund, Manuel
    Adeniyi, Kemisola
    Andela, Bouwe
    Arnone, Enrico
    Berg, Peter
    Caron, Louis-Philippe
    Cionni, Irene
    Corti, Susanna
    Drost, Niels
    Hunter, Alasdair
    Lledo, Llorenc
    Mohr, Christian Wilhelm
    Pacal, Aytac
    Perez-Zanon, Nuria
    Predoi, Valeriu
    Sandstad, Marit
    Sillmann, Jana
    Sterl, Andreas
    Vegas-Regidor, Javier
    von Hardenberg, Jost
    Eyring, Veronika
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2021, 14 (06) : 3159 - 3184
  • [2] Earth System Model Evaluation Tool (ESMValTool) v2.0-diagnostics for emergent constraints and future projections from Earth system models in CMIP
    Lauer, Axel
    Eyring, Veronika
    Bellprat, Omar
    Bock, Lisa
    Gier, Bettina K.
    Hunter, Alasdair
    Lorenz, Ruth
    Perez-Zanon, Nuria
    Righi, Mattia
    Schlund, Manuel
    Senftleben, Daniel
    Weigel, Katja
    Zechlau, Sabrina
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2020, 13 (09) : 4205 - 4228
  • [3] Earth System Model Evaluation Tool (ESMValTool) v2.0-technical overview
    Righi, Mattia
    Andela, Bouwe
    Eyring, Veronika
    Lauer, Axel
    Predoi, Valeriu
    Schlund, Manuel
    Vegas-Regidor, Javier
    Bock, Lisa
    Broetz, Bjorn
    de Mora, Lee
    Diblen, Faruk
    Dreyer, Laura
    Drost, Niels
    Earnshaw, Paul
    Hassler, Birgit
    Koldunov, Nikolay
    Little, Bill
    Tomas, Saskia Loosveldt
    Zimmermann, Klaus
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2020, 13 (03) : 1179 - 1199
  • [4] ESMValTool (v1.0) - a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
    Eyring, Veronika
    Righi, Mattia
    Lauer, Axel
    Evaldsson, Martin
    Wenzel, Sabrina
    Jones, Colin
    Anav, Alessandro
    Andrews, Oliver
    Cionni, Irene
    Davin, Edouard L.
    Deser, Clara
    Ehbrecht, Carsten
    Friedlingstein, Pierre
    Gleckler, Peter
    Gottschaldt, Klaus-Dirk
    Hagemann, Stefan
    Juckes, Martin
    Kindermann, Stephan
    Krasting, John
    Kunert, Dominik
    Levine, Richard
    Loew, Alexander
    Maekelae, Jarmo
    Martin, Gill
    Mason, Erik
    Phillips, Adam S.
    Read, Simon
    Rio, Catherine
    Roehrig, Romain
    Senftleben, Daniel
    Sterl, Andreas
    van Ulft, Lambertus H.
    Walton, Jeremy
    Wang, Shiyu
    Williams, Keith D.
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2016, 9 (05) : 1747 - 1802
  • [5] Evaluation of native Earth system model output with ESMValTool v2.6.0
    Schlund, Manuel
    Hassler, Birgit
    Lauer, Axel
    Andela, Bouwe
    Joeckel, Patrick
    Kazeroni, Remi
    Tomas, Saskia Loosveldt
    Medeiros, Brian
    Predoi, Valeriu
    Senesi, Stephane
    Servonnat, Jerome
    Stacke, Tobias
    Vegas-Regidor, Javier
    Zimmermann, Klaus
    Eyring, Veronika
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2023, 16 (01) : 315 - 333
  • [6] Evaluation of Ocean Biogeochemistry and Carbon Cycling in CMIP Earth System Models With the International Ocean Model Benchmarking (IOMB) Software System
    Fu, Weiwei
    Moore, J. Keith
    Primeau, Francois
    Collier, Nathan
    Ogunro, Oluwaseun O.
    Hoffman, Forrest M.
    Randerson, James T.
    JOURNAL OF GEOPHYSICAL RESEARCH-OCEANS, 2022, 127 (10)
  • [7] Evaluation of the effect of operational condition parameters on the large-scale V-ASP performance and system regulation measures
    Yuan, Jiajia
    Dong, Wenyi
    Sun, Feiyun
    PROCEEDINGS OF THE 2016 INTERNATIONAL FORUM ON ENERGY, ENVIRONMENT AND SUSTAINABLE DEVELOPMENT (IFEESD), 2016, 75 : 960 - 964
  • [8] Diagnostic evaluation of the Community Earth System Model in simulating mineral dust emission with insight into large-scale dust storm mobilization in the Middle East and North Africa (MENA)
    Parajuli, Sagar Prasad
    Yang, Zong-Liang
    Lawrence, David M.
    AEOLIAN RESEARCH, 2016, 21 : 21 - 35
  • [9] Research on Comprehensive Evaluation Model of Power System Priority Scheduling with Large-scale New Energy Considering Multi-base and UHVDC Transmission
    Liu, Yiqun
    Wang, Yuqing
    Tian, Liyi
    Xie, Lirong
    Qi, Xin
    Wei, Liu
    Zeng, Ming
    PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON MATERIAL SCIENCE, ENERGY AND ENVIRONMENTAL ENGINEERING (MSEEE 2017), 2017, 125 : 375 - 380
  • [10] The E3SM Diagnostics Package (E3SM Diags v2.7): a Python']Python-based diagnostics package for Earth system model evaluation
    Zhang, Chengzhu
    Golaz, Jean-Christophe
    Forsyth, Ryan
    Vo, Tom
    Xie, Shaocheng
    Shaheen, Zeshawn
    Potter, Gerald L.
    Asay-Davis, Xylar S.
    Zender, Charles S.
    Lin, Wuyin
    Chen, Chih-Chieh
    Terai, Chris R.
    Mahajan, Salil
    Zhou, Tian
    Balaguru, Karthik
    Tang, Qi
    Tao, Cheng
    Zhang, Yuying
    Emmenegger, Todd
    Burrows, Susannah
    Ullrich, Paul A.
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2022, 15 (24) : 9031 - 9056