2024-11-23 –, Kit-Kat
At Delivery Hero, we process 10,000 requests per second using Go and Redis. Join us to learn how this powerful duo handles high-load telemetry data efficiently and cost-effectively, with scalability, resource optimization, and continuous innovation through customized data flows.
At Delivery Hero, we process a staggering 10,000 requests per second globally, particularly in our critical TIER1 flow, where we handle telemetry data primarily from riders' phones. In this session, we'll delve into how we harnessed the power of Go and Redis to handle this high-load, mission-critical system at an incredibly low cost.
Key Points:
Go and Redis as the Perfect Pair: Discover how Go and Redis form the backbone of our telemetry processing infrastructure. Go's concurrency model and performance complement Redis's high availability and resilience, enabling seamless handling of our demanding operations.
Efficient Data Management with Redis: Explore how Redis's versatile features, including sorted lists and key expiration (TTL), enable efficient telemetry data storage, event queue management, and fraud prevention. Learn how Go's native support for Redis interactions streamlines integration and enhances overall system performance.
Scalability Made Simple: Dive into how Go and Redis effortlessly scale to handle our high-volume telemetry flow. With Go's lightweight footprint and Redis's scalability features, such as automatic sharding and replication, we ensure our system remains responsive and reliable, even under peak loads.
Cost-Effectiveness and Resource Optimization: Learn how we achieved cost-effectiveness by leveraging the smallest Redis instances available, strategically deployed across multiple regions. Explore how Go's efficient resource utilization and Redis's pay-as-you-go pricing model contribute to significant cost savings without compromising performance.
Customized Data Flows and Experimentation: Our implementation with Redis has opened doors for various experiments, including different location frequency updates, giving us the flexibility to optimise and innovate based on unique service needs.testing different telemetry processing strategies, empowering continuous optimization and innovation.
Andrii has a total of 17 years of software engineering experience and has been very passionate about Go for the past 6 years. Over the past 4 years at Delivery Hero, he has adeptly harnessed Golang, excelling in constructing high-load applications, leveraging Golang's concurrency capabilities to engineer scalable solutions that optimise performance and handle substantial data processing tasks.