PyConDE & PyData Berlin 2024

Niklas Lederer

I'm a data person with a focus on machine learning and data science but also business background. Working for a few years now in the data world - especially with Python - I'm now the product lead for a team called Customer genAI Incubator at dmTECH which is the IT subsidiary of dm-drogerie markt.


LinkedIn

https://de.linkedin.com/in/niklas-lederer-1b2b60b7


Session

04-23
14:45
45min
From LLM as oracle to LLM as translator - our journey from theory to everyday’s practice in a corporate setting with dmGPT (and python)
Emma Haley, Niklas Lederer

Last year, dm-drogeriemarkt was among the first big German companies launching a tool for the coworkers to be able to unlock the power of LLMs in a secure setting. At the beginning, dmGPT was only a user interface pointing to a private instance of a foundation Model.
Listening to the needs of our colleagues, we quickly learned that this “naked” model – a super powerful NLP Model that can help them processing text - is not really what they needed: they needed a trustworthy, knowledge-rich assistant to help them accomplish their daily tasks.
In our journey towards this goal, we used python to shift the LLM’s role in dmGPT: from being the motor and only source of answers to being a translator between the user’s input in natural language and multiple software systems, the steering wheel that helps humans drive the flow.
Today, dmGPT is not only a statistical parrot anymore, now it is an open platform powered by internal knowledge.

In this talk we want to share with you the learnings and insights we gained while designing and implementing the new dmGPT.

PyData: Generative AI
A1