Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (CIEMAT), Madrid Spain
2 Barcelona, Spain Port d’Informació Cientifica (PIC), Barcelona, Spain
3 University of Nebraska-Lincoln, Lincoln, NE, USA
4 Benemérita Universidad Autónoma de Puebla, Puebla, México
5 University of Notre Dame, Notre Dame, IN, USA
6 University of Sofia, Sofia, Bulgaria
7 Fermi National Accelerator Laboratory, Batavia, IL, USA
8 University of Malaya, Kuala Lumpur, Malaysia
9 University of California San Diego, La Jolla, CA, USA
⇤ e-mail: firstname.lastname@example.org
Published online: 17 September 2019
The CMS Submission Infrastructure Global Pool, built on Glidein-WMS andHTCondor, is a worldwide distributed dynamic pool responsible for the allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated assessment of its scalability limitations. In addition, the Global Plmust be able to expand in a more heterogeneous environment, in terms of resource provisioning (combining Grid, HPC and Cloud) and workload submissi.A dedicated testbed has been set up to simulate such conditions with the purpose of finding potential bottlenecks in the software or its configuration. This report provides a thorough description of the various scalabilitydimensions in size and complexity that are being explored for the future Global Pool, along with the analysis and solutions to the limitations proposed with the support of the GlideinWMS and HTCondor developer teams.
© The Authors, published by EDP Sciences, 2019
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.