EPJ Web of Conferences (Jan 2019)

IceProd - a dataset management system for IceCube: update

  • Schultz David,
  • Díaz Vélez Juan Carlos

DOI
https://doi.org/10.1051/epjconf/201921403058
Journal volume & issue
Vol. 214
p. 03058

Abstract

Read online

IceCube is a cubic kilometer neutrino detector located at the south pole. IceProd is IceCube’s internal dataset management system, keeping track of where, when, and how jobs run. It schedules jobs from submitted datasets to HTCondor, keeping track of them at every stage of the lifecycle. Many updates have happened in the last years to improve stability and scalability, as well as increase user access. Along the way, the IceProd codebase switched from Python 2 to Python 3.