Private LLM Platform for a Public-Sector Organisation
Generative AI in daily use, with no data leaving the organisation and no dependency on external APIs.
Challenge
Staff needed generative AI for documents and IT operations, but sensitive data could not be sent to external AI providers.
Approach
Built an on-premise LLM server hosting 40+ open-source models (Llama 3, Mistral, CodeStral and embedding models) via Ollama, with a secure chat interface. Added RAG pipelines that index and search large document collections, and automated log analysis where the LLM writes summaries and suggested fixes directly into operational dashboards.
Result
Generative AI in daily use, with no data leaving the organisation and no dependency on external APIs.
Let’s find out what AI can do for you
A free, no-obligation 30-minute call. You describe your processes or data, and I show you where AI could help and what a sensible first step looks like.