HEP Benchmark Suite The centralized future of WLCG benchmarking

Abstract

The HEPiX Benchmarking Working Group has devised a new HEPspecific benchmark, HEPscore23. This benchmark is an instance of the underlying benchmarking tool that is HEPscore, also created by the Working Group during this endeavor. HEPscore can be set up to run different HEP Workloads, autonomous production applications sourced from various HEP experiments. Through study and analysis, a subset of those workloads was elected, the minimal set that best represented HEP applications overall. To streamline the benchmarking process, this benchmarking framework includes the HEP Benchmark Suite, which facilitates the execution of HEPscore and other benchmarks, such as HEP-SPEC06, SPEC CPU 2006, and DB12. This paper elucidates the rationale behind the benchmark, and the framework created to develop it, delineates the key design considerations, diving into the motivations behind it and the flexibility and advantages that is offers as a replacement of HS06 in the WLCG and HEP communities.