ComputeOps: containers for High Performance Computing

Cécile Cavet; Aurélien Bailly-Reyre; David Chamont; Olivier Dadoun; Alexandre Dehne Garcia; Pierre-Emmanuel Guérin; Pascale Hennion; Oleg Lodygensky; Gérard Marchal-Duval; Emmanuel Medernach; Victor Mendoza; Jérôme Pansanel; Richard Randriatoamanana; Andrea Sartirana; Martin Souchal; Julien Tugler

doi:10.1051/epjconf/201921407004

Proceedings

Open Access

EPJ Web of Conferences 214, 07004 (2019)
https://doi.org/10.1051/epjconf/201921407004

ComputeOps: containers for High Performance Computing

Cécile Cavet¹^*, Aurélien Bailly-Reyre⁵^,8, David Chamont⁶, Olivier Dadoun⁸, Alexandre Dehne Garcia³, Pierre-Emmanuel Guérin², Pascale Hennion⁷, Oleg Lodygensky⁶, Gérard Marchal-Duval⁶, Emmanuel Medernach⁴, Victor Mendoza⁸, Jérôme Pansanel⁴, Richard Randriatoamanana², Andrea Sartirana⁷, Martin Souchal¹ and Julien Tugler⁷

¹ APC/FACe, Université de Paris, CNRS/IN2P3, CEA/Irfu, Obs. de Paris, 10 rue A. Domon et L. Duquet, 75013 Paris, France
² ICI-CNSC, 1 Rue de la Noe, 44321 Nantes, France
³ CBGP, INRA, CIRAD, IRD, Montpellier SupAgro, University Montpellier, Montpellier, France
⁴ IPHC, 23, rue du Loess - BP28, 67037 Strasbourg Cedex 2, France
⁵ ISCD, BP380, 4, place Jussieu, 75252 Paris Cedex 5, France
⁶ LAL, Centre Scientifique d’Orsay, Bat. 200 - BP34, 91898 Orsay Cedex, France
⁷ LLR, Ecole Polytechnique, Rue de Fresnel, 91128 Palaiseau, France
⁸ LPNHE, Campus de Jussieu, 4 place Jussieu, 75252 Paris Cedex 5, France

^* e-mail: ccavet@apc.in2p3.fr

Published online: 17 September 2019

Abstract

The High Performance Computing (HPC) domain aims to optimize code to use the latest multicore and parallel technologies including specific processor instructions. In this computing framework, portability and reproducibility are key concepts. A way to handle these requirements is to use Linux containers. These "light virtual machines" allow users to encapsulate applications within its environment in processes. Containers have been recently highlighted because they provide multi-infrastructure environnement for both developers and system administrators. Furthermore, they offer reproducibility due to image building files. Two container solutions are emerging: Docker for micro-services and Singularity for computing applications. We present here the Com-puteOps project which investigates the container benefits for HPC applications.

© The Authors, published by EDP Sciences, 2019

This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.