https://doi.org/10.1051/epjconf/202024507022
The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS
1
ETH (Zurich, Switzerland)
2
CERN (Geneva, Switzerland), IT department
3
CERN (Geneva, Switzerland), EP-ADP group
* main authors email: bcoralie@ethz.ch, email: firstname.lastname@cern.ch, email: Mario.Lassnig@cern.ch
Published online: 16 November 2020
We present NOTED, a project to better exploit WAN bandwidth for Rucio and FTS data transfers. We describe the developed software tool-box and a successful demonstration of automated load-balancing in the production network. The first component is the Transfer Broker: It identifies large data transfers for which network reconfiguration is both possible and beneficial, and translates the transfer information into parameters that can be used by network controllers. It will make this information available via a public interface. The second component is a demonstration of a Network Controller. It periodically reads the parameters provided by the Transfer Broker, and so decides which actions to apply to improve the network utilisation for a given transfer.
© The Authors, published by EDP Sciences, 2020
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.