Private LLM Platform for a Public-Sector Organisation
- Challenge
- Staff needed generative AI for documents and IT operations, but sensitive data could not be sent to external AI providers.
- Result
- Generative AI in daily use, with no data leaving the organisation and no dependency on external APIs.
- Ollama
- Open WebUI
- RAG
- Embeddings
- C#
- Azure DevOps