Title: MeerKATHI: A configurable, portable and system agnostic MeerKAT data reduction pipeline
The process of creating science data products in astronomy can be cumbersome and unreliable for a number of reasons. The most important among these are; i) the data reduction pipelines used are so complex that only a few individuals can understand, hence fully utilise them; ii) these pipelines are often poorly documented, making them unnecessarily opaque and difficult to debug; and iii) the software applications required to run the pipelines only work in suitably customized (operating system, library versions, system settings) computing environments. I will present MeerKATHI, a stimela-based end-to-end radio interferometry data reduction tool that leverages container technology to circumvent the aforementioned challenges. The result is a system agnostic, configurable and portable pipelining tool that produces reproducible science products that is easy to install and use. The utility and flexibility of the pipeline will be illustrated through some of the successes and challenges we have had when processing commissioning data from the MeerKAT telescope.
Note: stimela github – https://github.com/SpheMakh/Stimela