Frontiers in Physics (Jan 2024)

Turning European XFEL raw data into user data

  • Philipp Schmidt,
  • Karim Ahmed,
  • Cyril Danilevski,
  • David Hammer,
  • Robert Rosca,
  • Thomas Kluyver,
  • Thomas Michelat,
  • Egor Sobolev,
  • Luca Gelisio,
  • Luis Maia,
  • Maurizio Manetti,
  • Janusz Malka,
  • Krzysztof Wrona,
  • Jolanta Sztuk-Dambietz,
  • Vratko Rovensky,
  • Marco Ramilli,
  • Nuno Duarte,
  • David Lomidze,
  • Ibrahym Dourki,
  • Hazem Yousef,
  • Björn Senfftleben,
  • Olivier Meyer,
  • Monica Turcato,
  • Steffen Hauf,
  • Steve Aplin

DOI
https://doi.org/10.3389/fphy.2023.1321524
Journal volume & issue
Vol. 11

Abstract

Read online

The European X-ray Free Electron Laser is a research facility located close to Hamburg, offering X-ray pulses with ultra-high brilliance and femtosecond duration at megahertz repetition rates. The detection systems necessary to unlock the full scientific potential made possible by this machine poses considerable challenges both in terms of data volume and rate, as well as the interpretation of their recorded signal. To provide optimal data quality, expert and detector-specific knowledge not easily accessible to external facility users is essential, and its implementation must cope with the generated volumes. We therefore aim to perform these preparatory processing steps and offer users a dataset suitable for further analysis as the primary data product. This work describes the machinery and workflows providing this data to users in an automatic, configurable and reproducible manner, both online during the experiment, and offline for scientific analysis afterward on the way to publication.

Keywords