Ace Haidrey
Hi all,
I'm currently a software engineer on the big data platform team in Pinterest where our focus is on the workflow platform. We are migrating from old systems to this new one, which is built around airflow. Prior to here, I was on the data engineering team at Pandora where I first started exploring workflow systems and brought in a service built around Airflow there.
Outside of software, I help my family operate two pizza shops so coding and cooking are in my DNA!
Software Engineer at Pinterest
Session
07-08
11:00
45min
Airflow as the next Gen of workflow system at Pinterest
Dinghang Yu, Yulei Li, Ace Haidrey
To share the experience of adopting Airflow as the next generation of workflow system at pinterest, distributing the worker loads k8s, load sharding/partitioning via multiple schedulers, transparent existing user flow migration and more .
Use Cases
Bay Area Meetup [Session starts: Wednesday 08.07 9 am (Wednesday 08.07 9am PDT)]