Jacob Ferriero
Jake fell in love with open source process thanks to the inclusiveness and helpfulness of the Airflow Community. He's blessed to be a part of the Google Cloud Professional Services family which enables him in making GCP easier to use by building OSS tooling to help our customers.
Session
07-09
11:00
45min
Airflow CI/CD: Github to Cloud Composer (safely)
Jacob Ferriero
Deploying bad DAGs to your airflow environment can wreak havoc. This talk provides an opinionated take on a mono repo structure for GCP data pipelines leveraging BigQuery, Dataflow and a series of CI tests for validating your Airflow DAGs before deploying them to Cloud Composer.
Seattle Meetup [Session starts: Thursday 09.07 9am (Thursday 09.07 9am PDT)]