Yulei Li
I'm a Software Engineer @ Pinterest Workflow Team in the Data Org. I have been working on Airflow for almost a year and the team is in the progress of migrating from the old workflow platform to Airflow. Before joining Pinterest, I received my master degree from Carnegie Mellon University.
Software Engineer at Pinterest
Session
07-08
11:00
45min
Airflow as the next Gen of workflow system at Pinterest
Dinghang Yu, Yulei Li, Ace Haidrey
To share the experience of adopting Airflow as the next generation of workflow system at pinterest, distributing the worker loads k8s, load sharding/partitioning via multiple schedulers, transparent existing user flow migration and more .
Use Cases
Bay Area Meetup [Session starts: Wednesday 08.07 9 am (Wednesday 08.07 9am PDT)]