EPJ Web of Conferences (Jan 2021)

Exploitation of HPC Resources for data intensive sciences

  • Girone Maria,
  • Southwick David,
  • Khristenko Viktor,
  • Medeiros Miguel F.,
  • Giordano Domenico,
  • Brevik Høgstøyl Ingvild,
  • Atzori Luca

DOI
https://doi.org/10.1051/epjconf/202125102042
Journal volume & issue
Vol. 251
p. 02042

Abstract

Read online

The Large Hadron Collider (LHC) will enter a new phase beginning in 2027 with the upgrade to the High Luminosity LHC (HL-LHC). The increase in the number of simultaneous collisions coupled with a more complex structure of a single event will result in each LHC experiment collecting, storing, and processing exabytes of data per year. The amount of generated and/or collected data greatly outweighs the expected available computing resources. In this paper, we discuss effcient usage of HPC resources as a prerequisite for data-intensive science at exascale. First, we discuss the experience of porting CMS Hadron and Electromagnetic calorimeters reconstruction code to utilize Nvidia GPUs within the DEEP-EST project; second, we look at the tools and their adoption in order to perform benchmarking of a variety of resources available at HPC centers. Finally, we touch on one of the most important aspects of the future of HEP - how to handle the flow of petabytes of data to and from computing facilities, be it clouds or HPCs, for exascale data processing in a flexible, scalable and performant manner. These investigations are a key contribution to technical work within the HPC collaboration among CERN, SKA, GEANT and PRACE.