Assistant owner options
On this page
Once the assistant is on, the owner can point it at a model on the local network and decide how members' own keys and the monthly allowance work.
A local model#
Run Ollama or LM Studio on a machine in your network, choose Compatible endpoint, enter its base URL (Ollama: http://<host>:11434/v1; LM Studio: http://<host>:1234/v1) and a model that supports tools, and tick Allow private endpoints. Small models answer questions well but struggle with the multi-step skills: in testing, a 3-billion-parameter model handled Break this down but not the others, so choose a model of 7B or more for skills. Without that switch, addresses on private networks are refused, the same rule as for webhooks.
Other settings#
- Let members bring their own key: each person may then choose Anthropic, OpenAI or Google Gemini with their own model and key in Settings → Integrations → Assistant; their turns use it instead of yours. Members are never offered the compatible endpoint, so they cannot make your server connect to an address of their choosing. Turning this off makes everyone use your provider again (each person accepts its disclosure again); their choices are kept for when you turn it back on. Settings shows how many people use their own provider and key. What members see is in Assistant settings.
- Count members' own keys toward the monthly limit: off by default, so a member who pays with their own key is not held to your allowance. Turn it on to apply one limit to every answer. One answer at a time per person and 8 at a time on the server apply either way.
- Monthly tokens per person: 500,000 by default;
0means unlimited. - Changing the provider asks everyone to accept the disclosure again.
- Keys are stored in
<data>/secrets/assistant.json(mode 0600), never shown again, never in backups, exports or logs. The audit log recordssettings.changedwithassistant.<provider>.keygoing fromunsettoset, never the key.
Network details for operators are in Running with Docker; the routes are in the API reference.