2025-08-05 –, Kuiper Atrium
We present Hierarchical Adaptive Tiling Scheme (HATS, formerly referred to as hipscat), an advanced spatial partitioning of large datasets using Parquet storage. LSST Interdisciplinary Network for Collaboration and Computing (LINCC) Frameworks has built the LSDB library on top of the HATS format for efficient and scalable cross-matching and analysis of big datasets, to enable catalog builders to provide archival and future catalogs in HATS format. We have created a global partnership to provide survey data in HATS (including STScl, IPAC, CDS, and S-PLUS).
This poster highlights ongoing collaborations with Rubin and global archive providers to democratize cross-survey analysis.
Melissa (they/she) is Principal Software Engineer for LINCC Frameworks (LSST Interdisciplinary Network for Collaboration and Computing) at Carnegie Mellon University in Pittsburgh, PA. They additionally serve on the executive council for the LSST Informatics and Statistics Science Collaboration.