Leah Cole

Leah Cole is a developer programs engineer at Google, working on Composer, Google Cloud’s hosted version of Apache Airflow. Previously, she worked at GE for on multiple projects in the industrial IoT space. Leah is a graduate of Carleton College, where she studied computer science and also took enough German to have a semi-accidental minor. Outside of work, Leah likes playing piano, traveling, and crocheting.


What's your job title?

Developer Programs Engineer at Google


Sessions

07-14
11:00
45min
From S3 to BigQuery - How A First-Time Airflow User Successfully Implemented a Data Pipeline
Leah Cole

BigQuery is GCP's serverless, highly scalable and cost-effective cloud data warehouse that can analyze petabytes of data at super fast speeds. Amazon S3 is one of the oldest and most popular cloud storage offerings. Folks with data in S3 often want to use BigQuery to gain insights into their data. Using Apache Airflow, they can build pipelines to seamlessly orchestrate that connection. In this talk, Emily and Leah will walk through how they created an easily configurable pipeline to extract data

Use Cases
NYC Meetup,[Sessions start: Tuesday 14.07 12pm (Tuesday 14.07 9am PDT)]