ADASSX

The Keck Observatory Archive (KOA) curates records of over 100 million observations acquired by the 13 instruments (11 active, 2 retired) operating at the W. M. Keck Observatory,  and the archive is expected to grow rapidly as complex new instruments will soon be commissioned and as the expectations of archive users have expanded. In response, KOA has been deploying new Python based infrastructure. We have deployed real time ingestion of newly acquired data, and a dedicated interface for observers to manage these newly acquired data. We have been developing a new fast python-based VO-compliant query infrastructure. Our poster at ADASS 2024 identified the technologies chosen: Plotly-Dash, a low-code framework that exploits event-driven callbacks to simplify the handling of user interactions; R-tree spatial indexing to speedup spatial searches by x20; a VO-compliant TAP middleware, used already at the NASA Exoplanet Archive and the NEID archive; and mViewer, a visualization engine in the Montage Image Mosaic toolkit that is optimized for astronomy images.

These technologies will underpin new services that can be hosted on web pages or in Jupyter notebooks, and when completed, will replace the current query infrastructure. We have completed two new, fully functional interfaces that are in beta release. One is the Data Discovery Service, a web-based dashboard which queries the entire archive in seconds, and supports filtering observations by keywords, previewing results in a interactive data grid, visualizing images, and downloading raw, quicklook reduced and pipeline reduced data. The second is a Jupyter notebook that demonstrates how use CDS Vizier to create a list of protostars in the Rho Oph dark cloud, discover which Keck instruments have observations of them, and overlay the positions of the observations on an image downloaded from IRSA of Rho Oph, measured with the Infrared Array Camera.

This presentation describes the design of these services, and gives demonstrations of them in operation.