2025-04-24 –, Hassium
At Userlike, Celery is the backbone of our application, orchestrating over a 100 million tasks per month. In this talk, I’ll share real-world insights into scaling Celery, optimizing performance, avoiding common pitfalls, handling failures, and building a resilient architecture.
At Userlike, Celery plays a critical role as the backbone of our Django-based SaaS application, orchestrating over 100 million tasks per month with speed, reliability, and precision. In this talk, I’ll share the lessons we’ve learned while scaling Celery to handle massive workloads and support the needs of a growing user base. From optimizing performance and avoiding common pitfalls to handling failures gracefully and ensuring a resilient architecture, this session will provide actionable insights for developers and architects working with distributed task queues.
Whether you’re just starting with Celery or looking to scale an established system, you’ll walk away with practical tips, battle-tested strategies, and a deeper understanding of how to harness Celery’s full potential in real-world scenarios.
Outline:
• Introduction: Why Userlike needs a task queue, and why you need one too
• Fundamental concepts: latency, throughput, failure modes
• Optimizing Performance: Strategies for faster and more efficient task execution
• Avoiding Pitfalls: Common mistakes and how to mitigate them
• Handling Failures: Building fault-tolerant workflows and monitoring systems
• Resilient Architecture: Designing for reliability and scalability
• Key Takeaways: Practical tips for implementing and scaling Celery in your own projects
This talk is designed to be technical, engaging, and packed with real-world experiences to help you conquer the queue in your own applications.
Intermediate
Expected audience expertise: Python:Intermediate
Daniel is the CTO at Userlike, a leading SaaS company providing innovative customer communication solutions. He has a degree in Computer Science from the University of Karlsruhe and has been writing software professionally for over 20 years. He enjoys sharing his experiences and helping fellow developers level up their software development skills, and presented before at various Django and Python conferences throughout Europe. When not in front of a keyboard, he can be found training for his next marathon or building intricate Lego contraptions with his son.