DevConf.CZ

History of language models: Evolution, Frameworks, Deployment
06-13, 10:15–10:50 (Europe/Prague), E105 (capacity 70)

If language models seem a black box to you, join the talk to understand their history and importance. Language models have evolved over the years with key milestones and achievements that played a pivotal role in the field of Natural language processing. Starting from the early statistical, regular expression, and rule-based systems, the talk will progress to the emergence of neural networks based language models. We will go over landmark studies and breakthroughs that propelled the field with recent transformer based architecture along with large scale pretraining and transfer learning that has revolutionized language learning.

The research in the area fostered innovation in the open source world with adoption of projects such as PyTorch, Hugging Face, and LangChain. The frameworks democratized access to the technology and are further accelerating research and development. We will discuss key projects and ecosystems for developing and deploying applications with these technologies. Attendees will gain insights derived from real-life examples to enhance development with large language models.

See also:

Shrey Anand is a senior data scientist with over five years of experience in the field of AI / ML. He collaborates with the emerging technologies at Red Hat where he develops cutting-edge data science and generative AI solutions to solve complex business problems. As a strong advocate of open source, Shrey has made significant contributions to the community through his active involvement in various open source projects such as call for code, OS-climate, and Open Data Hub.