Geoscientific Model Development (Jan 2021)
Coordinating an operational data distribution network for CMIP6 data
- R. Petrie,
- S. Denvil,
- S. Ames,
- G. Levavasseur,
- S. Fiore,
- S. Fiore,
- C. Allen,
- F. Antonio,
- K. Berger,
- P.-A. Bretonnière,
- L. Cinquini,
- E. Dart,
- P. Dwarakanath,
- K. Druken,
- B. Evans,
- L. Franchistéguy,
- S. Gardoll,
- E. Gerbier,
- M. Greenslade,
- D. Hassell,
- A. Iwi,
- M. Juckes,
- S. Kindermann,
- L. Lacinski,
- M. Mirto,
- A. B. Nasser,
- P. Nassisi,
- E. Nienhouse,
- S. Nikonov,
- A. Nuzzo,
- C. Richards,
- S. Ridzwan,
- M. Rixen,
- K. Serradell,
- K. Snow,
- A. Stephens,
- M. Stockhause,
- H. Vahlenkamp,
- R. Wagner
Affiliations
- R. Petrie
- UK Research and Innovation, Swindon, UK
- S. Denvil
- Institut Pierre Simon Laplace, Centre National de Recherche Scientifique, Paris, France
- S. Ames
- Center for Applied Scientific Computing, Lawrence Livermore National Laboratory, Livermore, USA
- G. Levavasseur
- Institut Pierre Simon Laplace, Centre National de Recherche Scientifique, Paris, France
- S. Fiore
- Euro-Mediterranean Center on Climate Change Foundation, Lecce, Italy
- S. Fiore
- University of Trento, Trento, Italy
- C. Allen
- National Computational Infrastructure, Australian National University, Canberra, Australia
- F. Antonio
- Euro-Mediterranean Center on Climate Change Foundation, Lecce, Italy
- K. Berger
- German Climate Computing Center, Hamburg, Germany
- P.-A. Bretonnière
- Barcelona Supercomputing Center, Barcelona, Spain
- L. Cinquini
- Jet Propulsion Laboratory, National Aeronautics and Space Administration, Pasadena, USA
- E. Dart
- Energy Sciences Network, Lawrence Berkeley National Laboratory, Berkeley, USA
- P. Dwarakanath
- Linköping University, Linköping, Sweden
- K. Druken
- National Computational Infrastructure, Australian National University, Canberra, Australia
- B. Evans
- National Computational Infrastructure, Australian National University, Canberra, Australia
- L. Franchistéguy
- Centre National de Recherches Météorologiques, Université de Toulouse, Météo-France, CNRS, Toulouse, France
- S. Gardoll
- Institut Pierre Simon Laplace, Centre National de Recherche Scientifique, Paris, France
- E. Gerbier
- Centre National de Recherches Météorologiques, Université de Toulouse, Météo-France, CNRS, Toulouse, France
- M. Greenslade
- Institut Pierre Simon Laplace, Centre National de Recherche Scientifique, Paris, France
- D. Hassell
- National Centre of Atmospheric Science, Leeds, UK
- A. Iwi
- UK Research and Innovation, Swindon, UK
- M. Juckes
- UK Research and Innovation, Swindon, UK
- S. Kindermann
- German Climate Computing Center, Hamburg, Germany
- L. Lacinski
- Argonne National Laboratory, Chicago, USA
- M. Mirto
- Euro-Mediterranean Center on Climate Change Foundation, Lecce, Italy
- A. B. Nasser
- Institut Pierre Simon Laplace, Centre National de Recherche Scientifique, Paris, France
- P. Nassisi
- Euro-Mediterranean Center on Climate Change Foundation, Lecce, Italy
- E. Nienhouse
- National Center for Atmospheric Research, Boulder, USA
- S. Nikonov
- Geophysical Fluid Dynamics Laboratory, Princeton, USA
- A. Nuzzo
- Euro-Mediterranean Center on Climate Change Foundation, Lecce, Italy
- C. Richards
- National Computational Infrastructure, Australian National University, Canberra, Australia
- S. Ridzwan
- National Computational Infrastructure, Australian National University, Canberra, Australia
- M. Rixen
- World Meteorological Organization, Geneva, Switzerland
- K. Serradell
- Barcelona Supercomputing Center, Barcelona, Spain
- K. Snow
- National Computational Infrastructure, Australian National University, Canberra, Australia
- A. Stephens
- UK Research and Innovation, Swindon, UK
- M. Stockhause
- German Climate Computing Center, Hamburg, Germany
- H. Vahlenkamp
- Geophysical Fluid Dynamics Laboratory, Princeton, USA
- R. Wagner
- Argonne National Laboratory, Chicago, USA
- DOI
- https://doi.org/10.5194/gmd-14-629-2021
- Journal volume & issue
-
Vol. 14
pp. 629 – 644
Abstract
The distribution of data contributed to the Coupled Model Intercomparison Project Phase 6 (CMIP6) is via the Earth System Grid Federation (ESGF). The ESGF is a network of internationally distributed sites that together work as a federated data archive. Data records from climate modelling institutes are published to the ESGF and then shared around the world. It is anticipated that CMIP6 will produce approximately 20 PB of data to be published and distributed via the ESGF. In addition to this large volume of data a number of value-added CMIP6 services are required to interact with the ESGF; for example the citation and errata services both interact with the ESGF but are not a core part of its infrastructure. With a number of interacting services and a large volume of data anticipated for CMIP6, the CMIP Data Node Operations Team (CDNOT) was formed. The CDNOT coordinated and implemented a series of CMIP6 preparation data challenges to test all the interacting components in the ESGF CMIP6 software ecosystem. This ensured that when CMIP6 data were released they could be reliably distributed.
