BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//pretalx.com//pydata-amsterdam2026//talk//ASSD9U
BEGIN:VTIMEZONE
TZID:Europe/Amsterdam
BEGIN:DAYLIGHT
DTSTART:20250912T000000
TZNAME:CEST
TZOFFSETFROM:+0200
TZOFFSETTO:+0200
END:DAYLIGHT
BEGIN:STANDARD
DTSTART:20251026T030000
RDATE:20261025T030000
TZNAME:CET
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20260329T030000
RDATE:20270328T030000
TZNAME:CEST
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
SUMMARY:Reuniting the two distant cousins: Orchestrating your end-to-end D
 ata Engineering Workflow Leveraging Python in Apache Beam and Apache Airfl
 ow - Sadeeq Akintola
DTSTART;TZID=Europe/Amsterdam:20260912T140000
DTEND;TZID=Europe/Amsterdam:20260912T150000
DTSTAMP:20260809T124325Z
UID:pretalx-pydata-amsterdam2026-ASSD9U@pretalx.com
DESCRIPTION:Part 1: Introduction & The Problem (10% of time): Introduce Ap
 ache Beam and Apache Airflow as "distant cousins" in the data ecosystem an
 d highlight the common challenge of bridging the gap between large-scale d
 ata processing and workflow orchestration.\n\nPart 2: The Core Concepts (2
 0% of time): Explain the distinct\, complementary roles of each tool\, def
 ining Apache Beam's strength in unified\, large-scale data processing (bat
 ch/streaming) and Apache Airflow's role in scheduling\, monitoring\, and m
 anaging complex workflows\, both using beginner-friendly Python.\n\nPart 3
 : The Live Build: An End-to-End Workflow (50% of time): Provide a practica
 l demonstration showing how a Python-based Airflow DAG can trigger a Pytho
 n Apache Beam pipeline for a data processing task\, wait for its completio
 n\, and then orchestrate subsequent steps in the workflow.\n\nPart 4: Clou
 d Integration & Key Takeaways (20% of time): Showcase how to extend the pi
 peline by integrating with Google Cloud services like triggering a Cloud F
 unction\, loading results into BigQuery\, sending a completion notificatio
 n via SendGrid\, and making a call to a Gemini AI model for a final\, valu
 e-add step.
LOCATION:Room A
URL:https://pretalx.com/pydata-amsterdam2026/talk/ASSD9U/
END:VEVENT
END:VCALENDAR