Frontiers in Physics (Feb 2024)
Data reduction activities at European XFEL: early results
- Egor Sobolev,
- Philipp Schmidt,
- Janusz Malka,
- David Hammer,
- Djelloul Boukhelef,
- Johannes Möller,
- Karim Ahmed,
- Richard Bean,
- Ivette Jazmín Bermúdez Macías,
- Johan Bielecki,
- Ulrike Bösenberg,
- Cammille Carinan,
- Fabio Dall’Antonia,
- Sergey Esenov,
- Hans Fangohr,
- Hans Fangohr,
- Danilo Enoque Ferreira de Lima,
- Luís Gonçalo Ferreira Maia,
- Hadi Firoozi,
- Gero Flucke,
- Patrick Gessler,
- Gabriele Giovanetti,
- Jayanath Koliyadu,
- Anders Madsen,
- Thomas Michelat,
- Michael Schuh,
- Marcin Sikorski,
- Alessandro Silenzi,
- Jolanta Sztuk-Dambietz,
- Monica Turcato,
- Oleksii Turkot,
- James Wrigley,
- Steve Aplin,
- Steffen Hauf,
- Krzysztof Wrona,
- Luca Gelisio
Affiliations
- Egor Sobolev
- European XFEL, Schenefeld, Germany
- Philipp Schmidt
- European XFEL, Schenefeld, Germany
- Janusz Malka
- European XFEL, Schenefeld, Germany
- David Hammer
- European XFEL, Schenefeld, Germany
- Djelloul Boukhelef
- European XFEL, Schenefeld, Germany
- Johannes Möller
- European XFEL, Schenefeld, Germany
- Karim Ahmed
- European XFEL, Schenefeld, Germany
- Richard Bean
- European XFEL, Schenefeld, Germany
- Ivette Jazmín Bermúdez Macías
- European XFEL, Schenefeld, Germany
- Johan Bielecki
- European XFEL, Schenefeld, Germany
- Ulrike Bösenberg
- European XFEL, Schenefeld, Germany
- Cammille Carinan
- European XFEL, Schenefeld, Germany
- Fabio Dall’Antonia
- European XFEL, Schenefeld, Germany
- Sergey Esenov
- European XFEL, Schenefeld, Germany
- Hans Fangohr
- European XFEL, Schenefeld, Germany
- Hans Fangohr
- University of Southampton, Southampton, United Kingdom
- Danilo Enoque Ferreira de Lima
- European XFEL, Schenefeld, Germany
- Luís Gonçalo Ferreira Maia
- European XFEL, Schenefeld, Germany
- Hadi Firoozi
- European XFEL, Schenefeld, Germany
- Gero Flucke
- European XFEL, Schenefeld, Germany
- Patrick Gessler
- European XFEL, Schenefeld, Germany
- Gabriele Giovanetti
- European XFEL, Schenefeld, Germany
- Jayanath Koliyadu
- European XFEL, Schenefeld, Germany
- Anders Madsen
- European XFEL, Schenefeld, Germany
- Thomas Michelat
- European XFEL, Schenefeld, Germany
- Michael Schuh
- European XFEL, Schenefeld, Germany
- Marcin Sikorski
- European XFEL, Schenefeld, Germany
- Alessandro Silenzi
- European XFEL, Schenefeld, Germany
- Jolanta Sztuk-Dambietz
- European XFEL, Schenefeld, Germany
- Monica Turcato
- European XFEL, Schenefeld, Germany
- Oleksii Turkot
- European XFEL, Schenefeld, Germany
- James Wrigley
- European XFEL, Schenefeld, Germany
- Steve Aplin
- European XFEL, Schenefeld, Germany
- Steffen Hauf
- European XFEL, Schenefeld, Germany
- Krzysztof Wrona
- European XFEL, Schenefeld, Germany
- Luca Gelisio
- European XFEL, Schenefeld, Germany
- DOI
- https://doi.org/10.3389/fphy.2024.1331329
- Journal volume & issue
-
Vol. 12
Abstract
The European XFEL is a megahertz repetition-rate facility producing extremely bright and coherent pulses of a few tens of femtoseconds duration. The amount of data generated in the context of user experiments can exceed hundreds of gigabits per second, resulting in tens of petabytes stored every year. These rates and volumes pose significant challenges both for facilities and users thereof. In fact, if unaddressed, extraction and interpretation of scientific content will be hindered, and investment and operational costs will quickly become unsustainable. In this article, we outline challenges and solutions in data reduction.
Keywords
- data reduction
- photon science
- X-ray free electron laser
- data management
- high-repetition rate
- big data
