Min and Max Aggregations with Updates in Real Time.
2022-06-14 , Palais Atelier

As part of our analytics platform we handle real time ingestion and aggregations by performing aggregations such as count and sum based on roll ups such as day, hour and minute using Kafka streams app. We recently added support for Min and Max measures along with existing sum and count while performing aggregations on incoming Kafka records. The interesting part is that we also support all these aggregations on Updated records. This talk aims at exploring the interesting details that went into adding the Min and Max functionality to our Kafka streams app while performing real-time aggregations with Updates.


Get your ticket now!

Register for Berlin Buzzwords in our ticket shop! We also have online tickets and reduced tickets for students available and you can find more information about our Diversity Ticket Initiative here!

I am a Senior Software Engineer working in the Enterprise Insights team at Twilio. I am always excited about distributed systems, data driven technologies also interested in scalability and performance aspects of the product. I am always on the lookout for learning new technologies and optimizing the current usecases.