You can use both private LLM instances or hosted ones. On private we support Ollama, LM Studio and any OpenAI compatible API.

In hosted, we support: OpenAI, Anthropic, Gemini, OpenRouter, Vercel AI Gateway.

No native Amazon Bedrock support, but you could use OpenRouter or LiteLLM with the Bedrock key and point Rowboat to that today.