SoftwareX (Jul 2020)
ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management
- William F. Godoy,
- Norbert Podhorszki,
- Ruonan Wang,
- Chuck Atkins,
- Greg Eisenhauer,
- Junmin Gu,
- Philip Davis,
- Jong Choi,
- Kai Germaschewski,
- Kevin Huck,
- Axel Huebl,
- Mark Kim,
- James Kress,
- Tahsin Kurc,
- Qing Liu,
- Jeremy Logan,
- Kshitij Mehta,
- George Ostrouchov,
- Manish Parashar,
- Franz Poeschel,
- David Pugmire,
- Eric Suchyta,
- Keichi Takahashi,
- Nick Thompson,
- Seiji Tsutsumi,
- Lipeng Wan,
- Matthew Wolf,
- Kesheng Wu,
- Scott Klasky
Affiliations
- William F. Godoy
- Oak Ridge National Laboratory, Oak Ridge, TN, USA; Corresponding author.
- Norbert Podhorszki
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Ruonan Wang
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Chuck Atkins
- Kitware Inc., Clifton Park, NY, USA
- Greg Eisenhauer
- School of Computer Science, Georgia Institute of Technology, Atlanta, GA, USA
- Junmin Gu
- Lawrence Berkeley National Laboratory, Berkeley, CA, USA
- Philip Davis
- Computer Science Department, Rutgers University, New Brunswick, NJ, USA
- Jong Choi
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Kai Germaschewski
- Space Science Center and Physics Department, University of New Hampshire, Durham, NH, USA
- Kevin Huck
- University of Oregon, Eugene, OR, USA
- Axel Huebl
- Helmholtz-Zentrum Dresden - Rossendorf, Dresden, Germany
- Mark Kim
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- James Kress
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Tahsin Kurc
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY, USA
- Qing Liu
- Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ, USA
- Jeremy Logan
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Kshitij Mehta
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- George Ostrouchov
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Manish Parashar
- Computer Science Department, Rutgers University, New Brunswick, NJ, USA
- Franz Poeschel
- Helmholtz-Zentrum Dresden - Rossendorf, Dresden, Germany
- David Pugmire
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Eric Suchyta
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Keichi Takahashi
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Nick Thompson
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Seiji Tsutsumi
- Japan Aerospace Exploration Agency, Sagamihara, Kanagawa, Japan
- Lipeng Wan
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Matthew Wolf
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Kesheng Wu
- Lawrence Berkeley National Laboratory, Berkeley, CA, USA
- Scott Klasky
- Oak Ridge National Laboratory, Oak Ridge, TN, USA
- Journal volume & issue
-
Vol. 12
p. 100561
Abstract
We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2 addresses scientific data management needs ranging from scalable I/O in supercomputers, to data analysis in personal computer and cloud systems. Version 2 introduces a unified application programming interface (API) that enables seamless data movement through files, wide-area-networks, and direct memory access, as well as high-level APIs for data analysis. The internal architecture provides a set of reusable and extendable components for managing data presentation and transport mechanisms for new applications. ADIOS 2 bindings are available in C++11, C, Fortran, Python, and Matlab and are currently used across different scientific communities. ADIOS 2 provides a communal framework to tackle data management challenges as we approach the exascale era of supercomputing.