Elliot Blaine
Blaine is Sr Data Engineer at One Medical where he builds solutions for data pipelines and infrastructure. Blaine has 15+ years of experience within Data Engineering at various companies including MySpace, Chegg, Linkedin, and Microsoft.
Sr Data Engineer
Session
07-10
11:00
45min
Using Airflow to speed up development of data intensive tools
Elliot Blaine
In this talk we will review how Airflow helped create a tool to detect data anomalies. Leveraging Airlfow for process management, database interoperability, and authentication created an easy path forward to achieve scale, decrease the development time and pass security audits. While Airflow is generally looked at as a solution to manage data pipelines, integrating tools with Airlfow can also speed up development of those tools.
Warsaw Meetup [Session starts: Friday 10.07 6pm (Friday 10.07 9am PDT)]