https://doi.org/10.1051/epjconf/202024504010
The eXtreme-DataCloud project solutions for data management services in distributed e-infrastructures
1
Italian Institute for Nuclear Physics (INFN), INFN-CNAF, Bologna, Italy
2
Italian Institute for Nuclear Physics (INFN), INFN-BARI, Bari, Italy
3
Istituto de Fisica University of Cantabria (IFCA), Santander, Spain
4
Stiftung Deutsches Elektronen-Synchrotron (DESY), Hamburg, Germany
5
AGH University of Science and Technology (AGH-UST), Kracow, Poland
6
EGI Foundation, Amsterdam, the Netherlands
7
European Clinical Research Infrastructure Network (ECRIN), Paris, France
8
Centre National de la Recherche Scientifique (CNRS), IN2P3-LAPP, Annecy, France
9
European Organization for Nuclear Research (CERN), Genève, Switzerland
10
Centre National de la Recherche Scientifique (CNRS), IN2P3, Villeurbanne, France
11
European Clinical Research Infrastructure Network (ECRIN), Dusseldorf, Germany
Published online: 16 November 2020
The eXtreme DataCloud (XDC) project is aimed at developing data management services capable to cope with very large data resources allowing the future e-infrastructures to address the needs of the next generation extreme scale scientific experiments. Started in November 2017, XDC is combining the expertise of 8 large European research organisations. The project aims at developing scalable technologies for federating storage resources and managing data in highly distributed computing environments. The project is use case driven with a multidisciplinary approach, addressing requirements from research communities belonging to a wide range of scientific domains: Life Science, Biodiversity, Clinical Research, Astrophysics, High Energy Physics and Photon Science, that represent an indicator in terms of data management needs in Europe and worldwide. The use cases proposed by the different user communities are addressed integrating different data management services ready to manage an increasing volume of data. Different scalability and performance tests have been defined to show that the XDC services can be harmonized in different contexts and complex frameworks like the European Open Science Cloud. The use cases have been used to measure the success of the project and to prove that the developments fulfil the defined needs and satisfy the final users. The present contribution describes the results carried out from the adoption of the XDC solutions and provides a complete overview of the project achievements.
© The Authors, published by EDP Sciences, 2020
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
