2024-08-28 –, Room 7
Helmholtz Blablador is the LLM inference server from the Helmholtz Foundation. This talk explores Blablador's role in hosting open-source LLM models and models developed in-house at the Juelich Supercomputing Centre (JSC). This talk is about Blablador and the open source LLM models' ecosystem.
In the ever-evolving world of machine learning, the Helmholtz Foundation's Blablador stands out as an open LLM inference server/service for the academic community. This talk discusses Blablador and its role in hosting both open-source LLM models, models developed by the academic community in general, and those developed in-house at the Juelich Supercomputing Centre (JSC).
Blablador not only supports a wide range of models but also provides a robust platform for researchers and developers to experiment, collaborate, and innovate. As a result, Blablador has significantly contributed to the growth and advancement of the LLM models' ecosystem.
This talk will look at the architecture and functionality of Blablador, its integration with the JSC, and its impact on the LLM models' ecosystem. We explore Blablador's role in fostering collaboration and innovation in the machine learning community.
Blablador, the open LLM server for the academic community!
Category [Machine and Deep Learning]:Generative Models
Expected audience expertise: Domain:some
Expected audience expertise: Python:some
Project Homepage / Git:
HPC Specialist / AI Consultant
Maintainer of LMod, the Supercomputers's module system
Maintainer of FastChat
Ubuntu Member, Debian Developer
I AM BLABLADOR