Victor Shafran

Victor Shafran is cofounder of Databand, an APM and observability solution for data engineering teams. Victor brings 20 years of experience in enterprise software and data product development. In his last position as VP R&D at Equalum, a high growth startup in the data pipelining space, he led a team developing big data infrastructure for Fortune 100 companies. Before that, Victor was Director of Research at SAP and NICE Systems, where he led a team of data scientists on machine learning research. Victor holds an MBA from Tel Aviv University and an M.Sc (cum laude) in computer science.


What's your job title?

Co-Founder at Databand


Session

07-13
21:00
45min
Pipelines on Pipelines: Agile CI/CD Workflows for Airflow DAGs
Victor Shafran

How do you create fast and painless delivery of new DAGs into production? When running Airflow at scale, it becomes a big challenge to manage the full lifecycle around your pipelines; making sure that DAGs are easy to develop, test, and ship into prod. In this talk, we will cover our suggested approach to building a proper CI/CD cycle that ensures the quality and fast delivery of production pipelines.

Tokyo Meetup, [Sessions start: Tuesday 14.07 1 pm (Monday 13.07 9 pm PDT)]