https://doi.org/10.1051/epjconf/201921408031
MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure
1
CERN, European Laboratory for Particle Physics,
Geneva,
Switzerland
2
2 Universidad de Oviedo,
Oviedo,
Spain
3
Wroclaw University of Science and Technologys,
Wroclaw,
Poland
* e-mail: alberto.aimar@cern.ch
Published online: 17 September 2019
The new unified monitoring architecture (MONIT) for the CERN Data Centres and for the WLCG Infrastructure is based on established open source technologies to collect, stream, store and access monitoring data. The previous solutions, based on in-house development and commercial software, have been replaced with widely- recognized technologies such as Collectd, Kafka, Spark, Elasticsearch, InfluxDB, Grafana and others. The monitoring infrastructure, fully based on CERN cloud resources, covers the whole workflow of the monitoring data: from collecting and validating metrics and logs to making them available for dashboards, reports and alarms. The deployment in production of this new DC and WLCG monitoring is well under way and this contribution provides a summary of the progress, hurdles met and lessons learned in using these open source technologies. It also focuses on the choices made to achieve the required levels of stability, scalability and performance of the MONIT monitoring service.
© The Authors, published by EDP Sciences, 2019
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
