Cloud Endpoints and Data Residency

Choose the endpoint that best fits your application’s requirements—whether that’s using the default US region or ensuring your data stays within the European Union.

Default Endpoint

The default endpoint (llm-gateway.assemblyai.com) processes your LLM Gateway requests in the US region. If you don’t specify a base URL, this is the endpoint used by default.

EU Data Residency

The EU endpoint (llm-gateway.eu.assemblyai.com) guarantees your data never leaves the European Union. This is designed for organizations with strict data residency and governance requirements—your request and response data will remain entirely within the EU.

Endpoints

Endpoint	Base URL	Description
US (default)	`https://llm-gateway.assemblyai.com/v1/chat/completions`	Data stays in the US
EU	`https://llm-gateway.eu.assemblyai.com/v1/chat/completions`	Data stays in the EU

EU model availability

The EU endpoint currently supports Anthropic Claude and Google Gemini models. OpenAI models are only available through the US endpoint.

Provider	US	EU
Anthropic Claude	Yes	Yes
Google Gemini	Yes	Yes
OpenAI GPT	Yes	No
Alibaba Cloud Qwen	Yes	No
Moonshot AI Kimi	Yes	No

For a full list of available models, see the LLM Gateway Overview.

Which endpoint should I use?

No data residency requirements? Use the default endpoint. No configuration change is needed.
Need EU data residency? Use the EU endpoint to ensure your data stays within the European Union. Note that only Claude and Gemini models are available in the EU region.

How to use it

Update your request URL to your preferred endpoint. Select an endpoint tab below to see examples for each.

US (default)
EU data residency

The US endpoint is the default. No configuration change is required.

import requests

headers = {
  "authorization": "<YOUR_API_KEY>"
}

# No URL change needed — US is the default
response = requests.post(
    "https://llm-gateway.assemblyai.com/v1/chat/completions",
    headers=headers,
    json={
        "model": "claude-sonnet-4-6",
        "messages": [
            {"role": "user", "content": "What is the capital of France?"}
        ],
        "max_tokens": 1000
    }
)

result = response.json()
print(result["choices"][0]["message"]["content"])

Use the EU endpoint to keep your data within the European Union.

import requests

headers = {
  "authorization": "<YOUR_API_KEY>"
}

response = requests.post(
    "https://llm-gateway.eu.assemblyai.com/v1/chat/completions",
    headers=headers,
    json={
        "model": "claude-sonnet-4-6",
        "messages": [
            {"role": "user", "content": "What is the capital of France?"}
        ],
        "max_tokens": 1000
    }
)

result = response.json()
print(result["choices"][0]["message"]["content"])

Documentation Index

​Default Endpoint

​EU Data Residency

​Endpoints

​EU model availability

​Which endpoint should I use?