Limits of the HTCondor Transfer System
University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093. USA
2 University of Connecticut, 2152 Hill side Road, Storrs, CT06269-3046 Unit 3046. USA
3 Thomas Jefferson National Accelerator Facility, 12000 Jefferson Avenue, Newport News, VA 23606. USA
Published online: 17 September 2019
In the past, several scaling tests have been performed on the HTCondor batch system regarding its job scheduling capabilities. In this talk we report on a first set of scalability measurements of the file transfer capabilities of the HTCondor batch system. Motivated by the GlueX experiment needs we evaluate the limits and possible use of HTCondor as a solution to transport the output of jobs back to a submitter as a function of the number of concurrent jobs, the size of the output and the distance between a submitting node and computing node. We conclude that HTCondor transfer system satisfies the current GlueX computing demands.
© The Authors, published by EDP Sciences, 2019
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.