---
title: "模型備援（提供者失敗轉移）搭配 LiteLLM"
url: "/docs/tutorials/model_fallbacks"
canonical_url: "https://docs.litellm.ai/docs/tutorials/model_fallbacks"
type: "docs"
last_updated: "2026-10-08"
summary: "在 OpenAI、Anthropic 與 Azure 之間實作模型備援（提供者失敗轉移），讓失敗的提供者自動切換到備援。"
related:
  - "/docs/tutorials/provider_specific_params"
  - "/docs/tutorials/fallbacks"
---
# 模型備援（提供者失敗轉移）搭配 LiteLLM

> Index of all LiteLLM docs: https://docs.litellm.ai/llms.txt


以下說明如何使用 LiteLLM 在 3 個 LLM 提供者（OpenAI、Anthropic、Azure）之間實作模型備援（提供者失敗轉移）。

## 1. 安裝 LiteLLM {#1-install-litellm}
```bash
uv add litellm
```

## 2. 基本備援程式碼  {#2-basic-fallbacks-code}
```python 
import os
import traceback
import litellm
from litellm import embedding, completion

# set ENV variables
os.environ["OPENAI_API_KEY"] = ""
os.environ["ANTHROPIC_API_KEY"] = ""
os.environ["AZURE_API_KEY"] = ""
os.environ["AZURE_API_BASE"] = ""
os.environ["AZURE_API_VERSION"] = ""

model_fallback_list = ["claude-sonnet-5", "gpt-5.6-luna", "chatgpt-test"]

user_message = "Hello, how are you?"
messages = [{ "content": user_message,"role": "user"}]

for model in model_fallback_list:
  try:
      response = completion(model=model, messages=messages)
  except Exception as e:
      print(f"error occurred: {traceback.format_exc()}")
```

## 3. Context Window 例外狀況  {#3-context-window-exceptions}
LiteLLM 針對 Context Window Exceeded 錯誤提供了 InvalidRequestError 類別的子類別（[文件](https://docs.litellm.ai/docs/exception_mapping)）。

根據 context window 例外狀況實作模型備援。

使用 `litellm.get_model_info(model)["max_input_tokens"]` 來識別已超過的上下文視窗限制。`get_max_tokens()` 回傳的是模型的最大輸出 token 數，而不是其上下文視窗，因此不要將它與上下文視窗大小進行比較。 

以下備援清單中的模型 ID 僅為示意，並保留其上下文視窗大小。

```python keep-model-ids
import os
import litellm
from litellm import completion, ContextWindowExceededError

# set ENV variables
os.environ["OPENAI_API_KEY"] = ""
os.environ["COHERE_API_KEY"] = ""
os.environ["ANTHROPIC_API_KEY"] = ""
os.environ["AZURE_API_KEY"] = ""
os.environ["AZURE_API_BASE"] = ""
os.environ["AZURE_API_VERSION"] = ""

context_window_fallback_list = [{"model":"gpt-3.5-turbo-16k", "max_input_tokens": 16385}, {"model":"gpt-4-32k", "max_input_tokens": 32768}, {"model": "claude-instant-1", "max_input_tokens":100000}]

user_message = "Hello, how are you?"
messages = [{ "content": user_message,"role": "user"}]

initial_model = "command-nightly"

def completion_with_context_window_fallbacks(messages):
    try:
        return completion(model=initial_model, messages=messages)
    except ContextWindowExceededError:
        exceeded_limit = litellm.get_model_info(initial_model)["max_input_tokens"]
        for fallback in context_window_fallback_list:
            if exceeded_limit < fallback["max_input_tokens"]:
                try:
                    return completion(model=fallback["model"], messages=messages)
                except ContextWindowExceededError:
                    exceeded_limit = fallback["max_input_tokens"]
        raise

response = completion_with_context_window_fallbacks(messages)
print(response)
```

## Related pages

- [provider_specific_params](https://docs.litellm.ai/docs/tutorials/provider_specific_params.md)
- [使用 completion() 搭配備援（Failover）以提升可靠性](https://docs.litellm.ai/docs/tutorials/fallbacks.md)