The ECOMS User Data Gateway: Towards seasonal forecast data provision and research reproducibility in the era of Climate Services

Abstract

Sectorial applications of seasonal forecasting require data for a reduced number of variables from different datasets, mainly (gridded) observations, reanalysis, and predictions from state-of-the-art seasonal forecast systems (such as NCEP/CFSv2, ECMWF/System4 or UKMO/GloSea5). Whilst this information can be obtained directly from the data providers, the resulting formats, temporal aggregations, and vocabularies may not be homogeneous across datasets. Moreover, different data policies hold for the different databases, being only some of them publicly available. Therefore, obtaining and harmonizing multi-model seasonal forecast data for sector-specific applications is an error-prone, time consuming task.In order to facilitate this, the ECOMS User Data Gateway (ECOMS-UDG) was developed in the framework of the ECOMS initiative as a one-stop-service for climate data. To this aim, the variables required by end users were identified, downloaded from the data providers and locally stored as virtual datasets in a THREDDS Data Server (TDS), implementing fine-grained user management and authorization via the THREDDS Access Portal (TAP). As a result, users can retrieve the subsets best suited to their particular research needs in a user-friendly manner using the standard TDS data services. Moreover, an open source, R-based interface for data access and postprocessing was developed in the form of a bundle of packages implementing harmonized data access (one single vocabulary), data collocation, bias adjustment and downscaling, and forecast visualization and validation. This provides a unique comprehensive framework for end-to-end applications of seasonal predictions, hence favoring the reproducibility of the ECOMS scientific outcomes, extensible to the whole scientific community. Keywords: Seasonal forecasting, Open science, THREDDS, Reproducibility, R software, Bias adjustment, Downscaling, Validation