Rafael Ribaldo
Rafael Ribaldo is a Data Engineering Manager at QuintoAndar, where he leads a high-performance team towards building a data platform that can scale, has high performance and, most of all, is out of this world.
Before starting a career in Data Engineering, Ribaldo spent a couple of years as a Software Engineer writing Java code for companies in the payment and beverage businesses. After discovering a passion for Big Data projects, Ribaldo now helps QuintoAndar to continue to be a data driven company by making data available in a whole new level.
Ribaldo's available for discussing data architectures and the main goals to achieve data drivenness. You can reach him at rafael.ribaldo@quintoandar.com.br.
Data Engineering Manager at QuintoAndar
Session
Cross-DAG dependency may reduce cohesion in data pipelines and, without having an explicit solution in Airflow or in a third-party plugin, those pipelines tend to become complex to handle. That is the reason we, at QuintoAndar, have created an intermediate DAG to handle relationships across data pipelines called Mediator, in order for them to be scalable and maintainable by any team.