Leah Cole
Leah Cole is a developer programs engineer at Google, working on Composer, Google Cloud’s hosted version of Apache Airflow. Previously, she worked at GE for on multiple projects in the industrial IoT space. Leah is a graduate of Carleton College, where she studied computer science and also took enough German to have a semi-accidental minor. Outside of work, Leah likes playing piano, traveling, and crocheting.
Developer Programs Engineer at Google
Session
BigQuery is GCP's serverless, highly scalable and cost-effective cloud data warehouse that can analyze petabytes of data at super fast speeds. Amazon S3 is one of the oldest and most popular cloud storage offerings. Folks with data in S3 often want to use BigQuery to gain insights into their data. Using Apache Airflow, they can build pipelines to seamlessly orchestrate that connection. In this talk, Emily and Leah will walk through how they created an easily configurable pipeline to extract data