Skip to main content
Version: Next

View as Markdown

LLM Gateway

This guide is now organized into focused pages. Existing section links remain available below.

Overview​

See LLM Gateway overview.

Unified gateway​

See LLM Gateway overview.

The LLM Gateway page​

See LLM Gateway overview.

Administering the gateway​

See LLM Gateway overview.

Default models​

See LLM Gateway overview.

Provider notes​

See Configure providers and models.

Server configuration​

See Configure providers and models.

Routing rules and fallbacks​

See LLM Gateway overview.

Before you begin​

See LLM Gateway overview.

Getting your API key​

See Connect clients and applications.

Quick start with curl​

See Connect clients and applications.

Anthropic​

See Connect clients and applications.

OpenAI​

See Connect clients and applications.

Generic Responses Compatible​

See Connect clients and applications.

Amazon Bedrock​

See Connect clients and applications.

Azure​

See Connect clients and applications.

Provider setup​

See Configure providers and models.

Using with Claude Code​

See Connect clients and applications.

Claude Code with a Claude subscription​

See Connect clients and applications.

Claude Code with Amazon Bedrock Mantle​

See Connect clients and applications.

Claude Code with Azure​

See Connect clients and applications.

Using with Codex​

See Connect clients and applications.

Codex with Amazon Bedrock​

See Connect clients and applications.

Codex with Azure​

See Connect clients and applications.

Upgrading from model providers​

See Upgrading from model providers.

What happens on upgrade​

See Upgrading from model providers.

Client routes​

See Upgrading from model providers.

Other changes​

See Upgrading from model providers.

Limitations​

See API compatibility.

See API compatibility.