Prototyping access from visualisation tools to SKA science images and cubes stored in a rucio DataLake through IVOA discovery and access services
11-06, 08:30– (US/Arizona), Posters

Prototyping access from visualisation tools to SKA science images and cubes stored in a rucio DataLake through IVOA discovery and access services.

M.Allen, R.Barnsley, M.Baumann, F.Bonnarel, T.Boch, C.Bot, R.Butora, J.Collinson, P.Fernique, V.Galluzzi., R Joshi, M.Molinaro, M. Parra-Royon, J. Sanchez-Castaneda , S. Sanchez-Exposito, G.Tudisco, F .Vitello A.Zanichelli.

SKA is the major low frequency radioastronomy project of the future with several major scientific applications: It will upgrade the amount of available science data by several orders of magnitudes reaching eventually more than 700 petabytes of storage per year. The SKA observatory will proceed to the initial data processing to deliver observatory data products while the SKA Regional Center network (SRC) will provide storage for those and processing capabilities to deliver and store advanced data products for the user community.
Within the scope of the SRC network, Orange (visualisation), Magenta (data management) and Coral (node implementation) teams have prototyped the discovery acces and visualisation of science data. Our visualisation tools VisiVO and Aladin discover, access and visualize test science data produced by SKA pathfinders stored in the rucio DataLake. Science metadata functionality has been implemented by the Magenta team to the Rucio data lake prototype to demonstrate a means of enabling IVOA-compliant data discovery and server-side processing.
VisiVo, Aladin Desktop and Aladin Lite are able to query the Discovery service built on ObsCore and SCS IVOA protocols.
This allows them to load DataLink responses providing links towards a SODA cutout service developed by the Orange team able to extract subcubes or images directly from the datasets stored in the rucio DataLake.
The Rucio Storage Element and SODA developments have been deployed and configured on the Spanish SRC node, providing computing and storage resources, managed by the Coral Team members. This prototype paves the way to collaborative development in the SKA regional center network and shows the possible integration of VO services and visualisation tools in DataLakes and science platforms.

See also:

I'm working at CDS since 1987 as a software engineer. I'm working in the Aladin team and contributes to IVOA since 2002. I am involved in the SKA SRC network since spring 2022.

This speaker also appears in:

I am a radioastronomer and data steward, currently working at INAF - Istituto di Radioastronomia (IRA) in Bologna (Italy), member of the Italian Centre for Astronomical Archives (IA2), the IVOA Radio Interest Group and the Italian Square Kilometre Array Regional Centre (ITA-SRC).

I work for development and maintenance of the Italian radio telescopes data archive, and in promoting Open Science practices, e.g. by supporting IVOA initiatives and developments of data centres for future facilities, like the Square Kilometre Array (SKA).
I am also active in the fields of radio polarimetry/magnetism (mainly in Active Galactive Nuclei) and cosmology with radio telescopes.

This speaker also appears in:

Manuel Parra Royón is a postdoctoral researcher at the Instituto de Astrofísica de Andalucía (IAA-CSIC) in Spain. His research interests include data mining, machine learning, and big data analytics. He is currently working on the development of the SKA Regional Centres Network for the Square Kilometre Array Observatory (SKAO).

Manuel received his Ph.D. in computer science from the University of Granada in 2019. His dissertation focused on the use of machine learning for data mining in cloud computing. He also holds a Master's degree in Data Science and Intelligent Systems and a degree in Computer Science.

Before joining the IAA-CSIC, Parra Royón worked as researcher at the University of Granada, where he was involved in several projects on big data analytics, Machine Learning, IA and Science platforms. He also worked as a data engineer at the European Organization for Nuclear Research (CERN) in Geneva, Switzerland.

Parra Royón is passionate about using data science to solve real-world problems. He is particularly interested in using data mining to improve the efficiency and effectiveness of large-scale scientific experiments.

This speaker also appears in:

Working at the CDS from 2018, I did develop expertise in software development and visualisation for astronomy. Since then I did contribute to the maintenance of open source astronomy python libraries such as Astroquery, MOCpy and Aladin Lite. My main work is related to the development of the web viewer Aladin Lite. I am also part of SKA where I am involved in the SRC Network as a member of the team specialized in the visualisation of large radio data cubes.