---
title: "LLM Gateway"
version: "next"
canonical: "https://docs.obot.ai/next/functionality/llm-gateway"
unreleased: true
---

# LLM Gateway

This guide is now organized into focused pages. Existing section links remain available below.

- [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md)
- [Configure providers and models](https://docs.obot.ai/next/configuration/model-providers.md)
- [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md)
- [API compatibility](https://docs.obot.ai/next/llm-gateway/compatibility.md)
- [Upgrading from model providers](https://docs.obot.ai/next/llm-gateway/upgrade.md)

<a id="obot-doc-overview"></a>

## Overview

See [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md#obot-doc-overview).

<a id="obot-doc-unified-gateway"></a>

## Unified gateway

See [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md#obot-doc-unified-gateway).

<a id="obot-doc-the-models-page"></a>

## The LLM Gateway page

See [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md#obot-doc-the-models-page).

<a id="obot-doc-administering-the-gateway"></a>

## Administering the gateway

See [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md#obot-doc-administering-the-gateway).

<a id="obot-doc-default-models"></a>

## Default models

See [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md#obot-doc-default-models).

<a id="obot-doc-provider-notes"></a>

## Provider notes

See [Configure providers and models](https://docs.obot.ai/next/configuration/model-providers.md#obot-doc-provider-notes).

<a id="obot-doc-server-configuration"></a>

## Server configuration

See [Configure providers and models](https://docs.obot.ai/next/configuration/model-providers.md#obot-doc-server-configuration).

<a id="obot-doc-routing-rules-and-fallbacks"></a>

## Routing rules and fallbacks

See [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md#obot-doc-routing-rules-and-fallbacks).

<a id="obot-doc-before-you-begin"></a>

## Before you begin

See [LLM Gateway overview](https://docs.obot.ai/next/llm-gateway/how-it-works.md#obot-doc-before-you-begin).

<a id="obot-doc-getting-your-api-key"></a>

## Getting your API key

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-getting-your-api-key).

<a id="obot-doc-quick-start-with-curl"></a>

## Quick start with curl

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-quick-start-with-curl).

<a id="obot-doc-anthropic"></a>

## Anthropic

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-quick-start-with-curl).

<a id="obot-doc-openai"></a>

## OpenAI

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-quick-start-with-curl).

<a id="obot-doc-generic-responses-compatible"></a>

## Generic Responses Compatible

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-quick-start-with-curl).

<a id="obot-doc-amazon-bedrock"></a>

## Amazon Bedrock

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-quick-start-with-curl).

<a id="obot-doc-azure"></a>

## Azure

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-quick-start-with-curl).

<a id="obot-doc-provider-setup"></a>

## Provider setup

See [Configure providers and models](https://docs.obot.ai/next/configuration/model-providers.md).

<a id="obot-doc-using-with-claude-code"></a>

## Using with Claude Code

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-using-with-claude-code).

<a id="obot-doc-claude-code-with-a-claude-subscription"></a>

## Claude Code with a Claude subscription

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-claude-code-with-a-claude-subscription).

<a id="obot-doc-claude-code-with-amazon-bedrock-mantle"></a>

## Claude Code with Amazon Bedrock Mantle

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-using-with-claude-code).

<a id="obot-doc-claude-code-with-azure"></a>

## Claude Code with Azure

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-using-with-claude-code).

<a id="obot-doc-using-with-codex"></a>

## Using with Codex

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-using-with-codex).

<a id="obot-doc-codex-with-amazon-bedrock"></a>

## Codex with Amazon Bedrock

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-using-with-codex).

<a id="obot-doc-codex-with-azure"></a>

## Codex with Azure

See [Connect clients and applications](https://docs.obot.ai/next/llm-gateway/connect-clients.md#obot-doc-using-with-codex).

<a id="obot-doc-upgrading-from-model-providers"></a>

## Upgrading from model providers

See [Upgrading from model providers](https://docs.obot.ai/next/llm-gateway/upgrade.md).

<a id="obot-doc-what-happens-on-upgrade"></a>

## What happens on upgrade

See [Upgrading from model providers](https://docs.obot.ai/next/llm-gateway/upgrade.md#obot-doc-what-happens-on-upgrade).

<a id="obot-doc-client-routes"></a>

## Client routes

See [Upgrading from model providers](https://docs.obot.ai/next/llm-gateway/upgrade.md#obot-doc-client-routes).

<a id="obot-doc-other-changes"></a>

## Other changes

See [Upgrading from model providers](https://docs.obot.ai/next/llm-gateway/upgrade.md#obot-doc-other-changes).

<a id="obot-doc-limitations"></a>

## Limitations

See [API compatibility](https://docs.obot.ai/next/llm-gateway/compatibility.md#obot-doc-limitations).

<a id="obot-doc-related-topics"></a>

## Related topics

See [API compatibility](https://docs.obot.ai/next/llm-gateway/compatibility.md#obot-doc-related-topics).