Kader Miyanyedi
I have been a backend developer for 4 years, working primarily with Python and Django. I enjoy sharing what I’ve learned at previous PyCon talks and through writing on Medium, helping others improve their coding and AI skills.
Session
09-12
14:00
60min
LLM Evaluation in Production: A/B Testing and Observability
Kader Miyanyedi, Özge Çinko
Even small changes in LLMs can affect output quality, safety, and user experience. In this talk, we will show how to use Langfuse to log LLM outputs, run A/B tests, and track important metrics.
You will learn how to use data and experiments to improve your LLM applications and make better decisions during development.
Room B