https://doi.org/10.1051/epjconf/202024501038
Ingest pipeline for ASKAP
CSIRO Astronomy & Space Science, PO Box 76, Epping NSW 1710, Australia
* e-mail: Maxim.Voronkov@csiro.au
Published online: 16 November 2020
The Australian Square Kilometre Array Pathfinder (ASKAP) is a new generation 36-antenna 36-beam interferometer capable of producing about 2.2 Gb/s of raw data. The data are streamed from the observatory directly to the dedicated small cluster at the Pawsey Supercomputing centre. The ingest pipeline is a distributed real time software which runs on this cluster and prepares the data for further (offline) processing by imaging and calibration pipelines. In addition to its main functionality, it turned out to be a valuable tool for various commissioning experiments and allowed us to run an interim system to achieve the first scientific results much earlier than otherwise possible. I will review the architecture of the ingest pipeline, its role in the overall ASKAP design as well as the lessons learned by developing a real-time application in the HPC environment.
© The Authors, published by EDP Sciences, 2020
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
