BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//pretalx.com//pycon-lithuania-2026//speaker//RZSNJL
BEGIN:VTIMEZONE
TZID:EET
BEGIN:STANDARD
DTSTART:20000101T000000
RRULE:FREQ=YEARLY;BYMONTH=1;UNTIL=20011231T220000Z
TZNAME:EET
TZOFFSETFROM:+0200
TZOFFSETTO:+0200
END:STANDARD
BEGIN:STANDARD
DTSTART:20031026T050000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=10
TZNAME:EET
TZOFFSETFROM:+0300
TZOFFSETTO:+0200
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20030330T040000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=3
TZNAME:EEST
TZOFFSETFROM:+0200
TZOFFSETTO:+0300
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
UID:pretalx-pycon-lithuania-2026-FRRE9M@pretalx.com
DTSTART;TZID=EET:20260410T110000
DTEND;TZID=EET:20260410T112500
DESCRIPTION:Even small changes in LLMs can impact output quality\, safety\,
  and user experience. In this talk\, we’ll show how to log experiments w
 ith Langfuse\, automate tests with Pytest\, and enrich them using Hypothes
 is-generated random data scenarios. Participants will learn how to use cod
 e\, tests\, and data-driven A/B tests to improve LLM development.
DTSTAMP:20260617T080927Z
LOCATION:Krantas/Shore 213 (3rd building)
SUMMARY:Measuring Experiments in LLMs: A/B Tests and Automated Testing - Ö
 zge Çinko\, Kader Miyanyedi
URL:https://pretalx.com/pycon-lithuania-2026/talk/FRRE9M/
END:VEVENT
END:VCALENDAR