https://doi.org/10.1051/epjconf/202125102053
Towards Real-World Applications of ServiceX, an Analysis Data Transformation System
1 University of Texas at Austin
2 The University of Chicago
3 University of Illinois at Urbana-Champaign
4 University of Washington
* e-mail: kyungeonchoi@utexas.edu
Published online: 23 August 2021
One of the biggest challenges in the High-Luminosity LHC (HLLHC) era will be the significantly increased data size to be recorded and analyzed from the collisions at the ATLAS and CMS experiments. ServiceX is a software R&D project in the area of Data Organization, Management and Access of the IRIS-HEP to investigate new computational models for the HLLHC era. ServiceX is an experiment-agnostic service to enable on-demand data delivery specifically tailored for nearly-interactive vectorized analyses. It is capable of retrieving data from grid sites, on-the-fly data transformation, and delivering user-selected data in a variety of different formats. New features will be presented that make the service ready for public use. An ongoing effort to integrate ServiceX with a popular statistical analysis framework in ATLAS will be described with an emphasis of a practical implementation of ServiceX into the physics analysis pipeline.
© The Authors, published by EDP Sciences, 2021
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
