Geoscientific Model Development (Jul 2020)
Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP
- V. Eyring,
- V. Eyring,
- L. Bock,
- A. Lauer,
- M. Righi,
- M. Schlund,
- B. Andela,
- E. Arnone,
- E. Arnone,
- O. Bellprat,
- B. Brötz,
- L.-P. Caron,
- N. Carvalhais,
- N. Carvalhais,
- I. Cionni,
- N. Cortesi,
- B. Crezee,
- E. L. Davin,
- P. Davini,
- K. Debeire,
- L. de Mora,
- C. Deser,
- D. Docquier,
- P. Earnshaw,
- C. Ehbrecht,
- B. K. Gier,
- B. K. Gier,
- N. Gonzalez-Reviriego,
- P. Goodman,
- S. Hagemann,
- S. Hardiman,
- B. Hassler,
- A. Hunter,
- C. Kadow,
- C. Kadow,
- S. Kindermann,
- S. Koirala,
- N. Koldunov,
- N. Koldunov,
- Q. Lejeune,
- Q. Lejeune,
- V. Lembo,
- T. Lovato,
- V. Lucarini,
- V. Lucarini,
- V. Lucarini,
- F. Massonnet,
- B. Müller,
- A. Pandde,
- N. Pérez-Zanón,
- A. Phillips,
- V. Predoi,
- J. Russell,
- A. Sellar,
- F. Serva,
- T. Stacke,
- T. Stacke,
- R. Swaminathan,
- V. Torralba,
- J. Vegas-Regidor,
- J. von Hardenberg,
- J. von Hardenberg,
- K. Weigel,
- K. Weigel,
- K. Zimmermann
Affiliations
- V. Eyring
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- V. Eyring
- University of Bremen, Institute of Environmental Physics (IUP), Bremen, Germany
- L. Bock
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- A. Lauer
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- M. Righi
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- M. Schlund
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- B. Andela
- Netherlands eScience Center, Science Park 140, 1098 XG Amsterdam, the Netherlands
- E. Arnone
- Institute of Atmospheric Sciences and Climate, Consiglio Nazionale delle Ricerche (ISAC-CNR), Turin, Italy
- E. Arnone
- Department of Physics, University of Torino, Turin, Italy
- O. Bellprat
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- B. Brötz
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- L.-P. Caron
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- N. Carvalhais
- Department of Biogeochemical Integration, Max Planck Institute for Biogeochemistry, Jena, Germany
- N. Carvalhais
- Departamento de Ciências e Engenharia do Ambiente, DCEA, Faculdade de Ciências e Tecnologia, FCT, Universidade Nova de Lisboa, 2829-516 Caparica, Portugal
- I. Cionni
- Agenzia nazionale per le nuove tecnologie, l'energia e lo sviluppo economico sostenibile (ENEA), Rome, Italy
- N. Cortesi
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- B. Crezee
- ETH Zurich, Institute for Atmospheric and Climate Science, Zurich, Switzerland
- E. L. Davin
- ETH Zurich, Institute for Atmospheric and Climate Science, Zurich, Switzerland
- P. Davini
- Institute of Atmospheric Sciences and Climate, Consiglio Nazionale delle Ricerche (ISAC-CNR), Turin, Italy
- K. Debeire
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- L. de Mora
- Plymouth Marine Laboratory (PML), Plymouth, UK
- C. Deser
- National Center for Atmospheric Research (NCAR), Boulder, CO, USA
- D. Docquier
- Rossby Centre, Swedish Meteorological and Hydrological Institute (SMHI), Norrköping, Sweden
- P. Earnshaw
- Met Office, Exeter, UK
- C. Ehbrecht
- Deutsches Klimarechenzentrum, Hamburg, Germany
- B. K. Gier
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- B. K. Gier
- University of Bremen, Institute of Environmental Physics (IUP), Bremen, Germany
- N. Gonzalez-Reviriego
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- P. Goodman
- Department of Geosciences, University of Arizona, Tucson, AZ, USA
- S. Hagemann
- Institute of Coastal Research, Helmholtz-Zentrum Geesthacht (HZG), Geesthacht, Germany
- S. Hardiman
- Met Office, Exeter, UK
- B. Hassler
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- A. Hunter
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- C. Kadow
- Deutsches Klimarechenzentrum, Hamburg, Germany
- C. Kadow
- Freie Universität Berlin (FUB), Berlin, Germany
- S. Kindermann
- Deutsches Klimarechenzentrum, Hamburg, Germany
- S. Koirala
- Department of Biogeochemical Integration, Max Planck Institute for Biogeochemistry, Jena, Germany
- N. Koldunov
- MARUM, Center for Marine Environmental Sciences, Bremen, Germany
- N. Koldunov
- Alfred-Wegener-Institut Helmholtz-Zentrum für Polar- und Meeresforschung, Bremerhaven, Germany
- Q. Lejeune
- ETH Zurich, Institute for Atmospheric and Climate Science, Zurich, Switzerland
- Q. Lejeune
- Climate Analytics, Berlin, Germany
- V. Lembo
- CEN, University of Hamburg, Meteorological Institute, Hamburg, Germany
- T. Lovato
- Fondazione Centro Euro-Mediterraneo sui Cambiamenti Climatici (CMCC), Bologna, Italy
- V. Lucarini
- CEN, University of Hamburg, Meteorological Institute, Hamburg, Germany
- V. Lucarini
- Department of Mathematics and Statistics, University of Reading, Department of Mathematics and Statistics, Reading, UK
- V. Lucarini
- Centre for the Mathematics of Planet Earth, University of Reading, Centre for the Mathematics of Planet Earth Department of Mathematics and Statistics, Reading, UK
- F. Massonnet
- Georges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium
- B. Müller
- Ludwig Maximilians Universität (LMU), Department of Geography, Munich, Germany
- A. Pandde
- Department of Geosciences, University of Arizona, Tucson, AZ, USA
- N. Pérez-Zanón
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- A. Phillips
- National Center for Atmospheric Research (NCAR), Boulder, CO, USA
- V. Predoi
- NCAS Computational Modelling Services (CMS), University of Reading, Reading, UK
- J. Russell
- Department of Geosciences, University of Arizona, Tucson, AZ, USA
- A. Sellar
- Met Office, Exeter, UK
- F. Serva
- Institute of Marine Sciences, Consiglio Nazionale delle Ricerche (ISMAR-CNR), Rome, Italy
- T. Stacke
- Institute of Coastal Research, Helmholtz-Zentrum Geesthacht (HZG), Geesthacht, Germany
- T. Stacke
- Max Planck Institute for Meteorology (MPI-M), Hamburg, Germany
- R. Swaminathan
- Department of Meteorology, University of Reading, Reading, UK
- V. Torralba
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- J. Vegas-Regidor
- Barcelona Supercomputing Center (BSC), Barcelona, Spain
- J. von Hardenberg
- Institute of Atmospheric Sciences and Climate, Consiglio Nazionale delle Ricerche (ISAC-CNR), Turin, Italy
- J. von Hardenberg
- Department of Environment, Land and Infrastructure Engineering, Politecnico di Torino, Turin, Italy
- K. Weigel
- Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
- K. Weigel
- University of Bremen, Institute of Environmental Physics (IUP), Bremen, Germany
- K. Zimmermann
- Rossby Centre, Swedish Meteorological and Hydrological Institute (SMHI), Norrköping, Sweden
- DOI
- https://doi.org/10.5194/gmd-13-3383-2020
- Journal volume & issue
-
Vol. 13
pp. 3383 – 3438
Abstract
The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth system models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility. It consists of (1) an easy-to-install, well-documented Python package providing the core functionalities (ESMValCore) that performs common preprocessing operations and (2) a diagnostic part that includes tailored diagnostics and performance metrics for specific scientific applications. Here we describe large-scale diagnostics of the second major release of the tool that supports the evaluation of ESMs participating in CMIP Phase 6 (CMIP6). ESMValTool v2.0 includes a large collection of diagnostics and performance metrics for atmospheric, oceanic, and terrestrial variables for the mean state, trends, and variability. ESMValTool v2.0 also successfully reproduces figures from the evaluation and projections chapters of the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) and incorporates updates from targeted analysis packages, such as the NCAR Climate Variability Diagnostics Package for the evaluation of modes of variability, the Thermodynamic Diagnostic Tool (TheDiaTo) to evaluate the energetics of the climate system, as well as parts of AutoAssess that contains a mix of top–down performance metrics. The tool has been fully integrated into the Earth System Grid Federation (ESGF) infrastructure at the Deutsches Klimarechenzentrum (DKRZ) to provide evaluation results from CMIP6 model simulations shortly after the output is published to the CMIP archive. A result browser has been implemented that enables advanced monitoring of the evaluation results by a broad user community at much faster timescales than what was possible in CMIP5.
