Skip to content

Bring your own model

  • Have an OpenAI-compatible model endpoint available (for example Ollama, LM Studio, or OpenRouter).
  • Have the endpoint URL and API key (if required).
  1. Open Settings and choose Preferences, then Available AI Models.
  2. In server management, click Add server and enter the server URL.
  3. Add API key if required by your provider, then click Connect.
  4. Enable one or more models from the connected server.
  5. Select the enabled model in AI Chat.
  6. Open model settings and configure optional system prompt, temperature, top_p, and top_k values.
  7. Send a test prompt to verify the model responds.
  8. For secure handling, note that API keys are stored in session storage and cleared on disconnect/session end.
  • The custom server shows as connected in model settings.
  • Enabled external models appear in the AI model selector.
  • Test prompts return responses from the selected external model.
  • Model parameter changes persist for that model profile.
  • Connection fails
  • Confirm URL format, server uptime, and CORS setup for browser access.
  • Model list is empty
  • Refresh server models and verify the endpoint exposes /models.
  • Agent is chat-only
  • Check server mode/tool-calling support and use a model/server combination that supports agent actions.
  • Auth errors persist
  • Re-enter API key and reconnect from Models and AI settings.