EPJ Web of Conferences (Jan 2020)

ROOT I/O compression improvements for HEP analysis

  • Shadura Oksana,
  • Bockelman Brian Paul,
  • Canal Philippe,
  • Piparo Danilo,
  • Zhang Zhe

DOI
https://doi.org/10.1051/epjconf/202024502017
Journal volume & issue
Vol. 245
p. 02017

Abstract

Read online

We overview recent changes in the ROOT I/O system, enhancing it by improving its performance and interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly improve experiment’s software performance. The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased over the last couple of years. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly, because there are significant trade-offs between the increased CPU cost for reading and writing files and the reduces storage space.