Running Roman pipelines in NASA cloud with Airflow and Kubernetes
11-06, 08:30– (US/Arizona), Posters

The Nancy Grace Roman Space Telescope is a NASA observatory to unravel dark energy and dark matter, search for and image exoplanets, and explore infrared astrophysics. This talk highlights the solution adopted by the Roman SSC team at Caltech/IPAC to run data pipelines using Airflow and Kubernetes in the NASA cloud.

See also:

Emmanuel Joliet has over 20 years of experience in the space and aeronautical industries, working on software development, data visualization, and data processing. His background is space engineering and astronomy.

He joined Gaia Science Operations team at ESAC in 2006 and contributed to key aspects of the mission.

In 2015, he moved to California to become the UI team lead for the NASA/IPAC Infrared Science Archive at Caltech.

Since 2020, he took the role of leading the Roman SSC pipeline development team and configuration management.

He is the project lead of Firefly (https://github.com/Caltech-IPAC/firefly), an open-source web-based UI library for astronomical data archive access and visualization.

He is a Cloudera Certified Developer for Apache Hadoop and HBase Specialist, and has a certificate in Machine Learning and data analytics from Caltech. He is also a HEALPix developer.

He's trained as Cloud Architect and developer using AWS, Azure and Google Cloud platform tools.

Publications: https://orcid.org/0000-0003-4824-0102