Data in Brief (Jun 2022)

Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data

  • Alexandre F. Boyer,
  • Christophe Haen,
  • Federico Stagni,
  • David R.C. Hill

Journal volume & issue
Vol. 42
p. 108104

Abstract

Read online

To take advantage of the computing power offered by grid and opportunistic resources, the CERN Large Hadron Collider (LHC) experiments have adopted the Pilot-Job paradigm. In this work, we study the DIRAC Site Director, one of the existing Pilot-Job provisioning solutions, mainly developed and used by the beauty experiment (LHCb). The purpose is to improve the Pilot-Job submission rates and the throughput of the jobs on grid resources. To analyze the DIRAC Site Director mechanisms and assess our contributions, we collected data over 12 months from the LHCbDIRAC instance. We extracted data from the DIRAC databases and the logs. Data include (i) evolution of the number of Pilot-Jobs/jobs over time; (ii) slots available in grid Sites; (iii) number of jobs processed per Pilot-Job.

Keywords