EPJ Web of Conferences (Jan 2019)

Sharing server nodes for storage and computer

  • Smith David,
  • Di Girolamo Alessandro,
  • Glushkov Ivan,
  • Jones Ben,
  • Kiryanov Andrey,
  • Lamanna Massimo,
  • Mascetti Luca,
  • McCance Gavin,
  • Rousseau Herve,
  • Schovancová Jaroslava,
  • Schulz Markus,
  • Tollefsen Havard,
  • Valassi Andrea

DOI
https://doi.org/10.1051/epjconf/201921408025
Journal volume & issue
Vol. 214
p. 08025

Abstract

Read online

Based on the observation of low average CPU utilisation of several hundred file storage servers in the EOS storage system at CERN, the Batch on EOS Extra Resources (BEER) project developed an approach to also utilise these resources for batch processing. Initial proof of concept tests showed little interference between batch and storage services on a node. Subsequently a model for production was developed and implemented. This has been deployed on part of the CERN EOS production service. The implementation and test results will be presented. The potential for additional resources at the CERN Tier-0 centre is of the order of ten thousand hardware threads in the near term, as well as being a step towards a hyper-converged infrastructure.