BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//pretalx.com//pydata-amsterdam2026//talk//QCHL8T
BEGIN:VTIMEZONE
TZID:Europe/Amsterdam
BEGIN:DAYLIGHT
DTSTART:20250912T000000
TZNAME:CEST
TZOFFSETFROM:+0200
TZOFFSETTO:+0200
END:DAYLIGHT
BEGIN:STANDARD
DTSTART:20251026T030000
RDATE:20261025T030000
TZNAME:CET
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20260329T030000
RDATE:20270328T030000
TZNAME:CEST
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
SUMMARY:LLM Evaluation in Production: A/B Testing and Observability - Kade
 r Miyanyedi\, Özge Çinko
DTSTART;TZID=Europe/Amsterdam:20260912T140000
DTEND;TZID=Europe/Amsterdam:20260912T150000
DTSTAMP:20260809T124338Z
UID:pretalx-pydata-amsterdam2026-QCHL8T@pretalx.com
DESCRIPTION:Even small changes in LLMs can affect output quality\, safety\
 , and user experience. In this talk\, we will show how to use Langfuse to 
 log LLM outputs\, run A/B tests\, and track important metrics.\n\nYou will
  learn how to use data and experiments to improve your LLM applications an
 d make better decisions during development.
LOCATION:Room B
URL:https://pretalx.com/pydata-amsterdam2026/talk/QCHL8T/
END:VEVENT
END:VCALENDAR