Tarun Jain
Tarun Jain is a Founding Engineer, Google Developer Expert in AI, and Qdrant Distinguished Ambassador. Tarun has contributed to Google Summer of Code 2024 at Red Hen Lab and Google Summer of Code 2023 at caMicroscope. He is a content creator on YouTube with the channel name: AI with Tarun.
Session
Running AI inference locally, processing AI models on an organization’s own hardware, such as on-premises servers or devices, rather than relying on cloud-based services, has become an increasingly popular choice across various industries. The primary appeal lies in the enhanced control and security it offers over sensitive data. In this workshop session, we will learn how to build a completely local Agentic RAG without any external APIs, using an open source LLM such as Gemma or Mistral, along with the Qdrant vector search engine, and monitor the application using Comet OPIK.