Don't Mess With My Data: Local AI + MCP on Linux
What if you could ask an AI "is my house good for solar panels?" - and get a real answer, without sending your address leaving your machine?
In this talk, we'll build a fully local AI agent stack on Linux that evaluates solar potential for any Texas property - no cloud APIs, no OpenAI key, no data leaving your network. We'll wire together Ollama running a local LLM, a custom MCP (Model Context Protocol) server exposing tools for geocoding and solar estimation, the free NREL PVWatts government API, and PostgreSQL for local storage. The result: an agent you can ask "what would solar look like on my roof?" and get a real, human-readable answer grounded in real data.
We'll cover:
- Running a local LLM with Ollama on Linux
- Building an MCP server that exposes real-world tools to any AI client
- Turning raw government solar data into plain-English savings estimates
- Persisting and querying results in local PostgreSQL
- Running the whole stack as a systemd service - no always-on laptop required
Texas gets 200+ sunny days a year and some of the most volatile electricity prices in the country thanks to ERCOT. This is a practical talk about what local, open source AI can actually do - on your hardware, on your terms, using a protocol you can reuse for your own tools tomorrow.
As the industry shifts from expensive frontier models toward cheaper, optimized inference this talk shows what's possible when you run capable AI agents directly on hardware you own.
Rajesh Alwar is a Systems Engineer with a background in cloud infrastructure and enterprise-scale systems, including designing on-premises edge compute solutions. Outside of work, he builds open source tooling for personal data analysis and automation from local LLM experimentation with Ollama to Python-based stock market scanners and Strava analytics pipelines. Rajesh is passionate about local-first, privacy-respecting AI and enjoys exploring how open source tools on Linux can replace cloud-dependent workflows without sacrificing capability.