An office AI assistant, without the data leaving
An AI assistant the whole team can use, running in the company's own account, with no data sent to an outside AI provider.
60 weekly users, no document leaves the firm
Staff wanted an AI assistant for drafting and summarising, but client documents could not be sent to an outside AI provider. I set up an open weight language model on a GPU server in the firm's own cloud account, in its own country, with a familiar chat interface behind the company sign in. Staff can upload a document and ask questions about it, and a set of prepared prompts covers the common jobs: summaries, first drafts, clause comparison. Nothing is stored outside the firm's account, and every conversation is logged for their own audit. Result: 60 staff using it every week, and 0 documents sent to a third party AI.
- Client
- Law firm, Australia
- Role
- Design, build and hand over
- Stack
- Open weight models (Llama, Qwen), vLLM, Open WebUI, Microsoft single sign on, Docker, a cloud GPU server
