/audio/transcriptions

總覽

功能	支援	備註
成本追蹤	✅	可與所有支援的模型搭配運作
記錄	✅	可跨所有整合搭配運作
終端使用者追蹤	✅
備援	✅	可在支援的模型之間運作
負載平衡	✅	可在支援的模型之間運作
防護欄	✅	套用至輸出的轉錄文字（僅限非串流）
支援的提供者	openai, azure, vertex_ai, gemini, deepgram, groq, fireworks_ai, ovhcloud, mistral

快速開始

LiteLLM Python SDK

Python SDK Example

from litellm import transcription
import os 

# set api keys 
os.environ["OPENAI_API_KEY"] = ""
audio_file = open("/path/to/audio.mp3", "rb")

response = transcription(model="whisper", file=audio_file)

print(f"response: {response}")

LiteLLM Proxy

將模型加入設定

OpenAI

OpenAI Configuration

model_list:
- model_name: whisper
  litellm_params:
    model: whisper-1
    api_key: os.environ/OPENAI_API_KEY
  model_info:
    mode: audio_transcription
    
general_settings:
  master_key: sk-1234

OpenAI + Azure

OpenAI + Azure Configuration

model_list:
- model_name: whisper
  litellm_params:
    model: whisper-1
    api_key: os.environ/OPENAI_API_KEY
  model_info:
    mode: audio_transcription
- model_name: whisper
  litellm_params:
    model: azure/azure-whisper
    api_version: 2024-02-15-preview
    api_base: os.environ/AZURE_EUROPE_API_BASE
    api_key: os.environ/AZURE_EUROPE_API_KEY
  model_info:
    mode: audio_transcription

general_settings:
  master_key: sk-1234

啟動 Proxy

Start Proxy Server

litellm --config /path/to/config.yaml 

# RUNNING on http://0.0.0.0:8000

測試

Curl

Test with cURL

curl --location 'http://0.0.0.0:8000/v1/audio/transcriptions' \
--header 'Authorization: Bearer sk-1234' \
--form 'file=@"/Users/krrishdholakia/Downloads/gettysburg.wav"' \
--form 'model="whisper"'

OpenAI Python SDK

Test with OpenAI Python SDK

from openai import OpenAI
client = openai.OpenAI(
    api_key="sk-1234",
    base_url="http://0.0.0.0:8000"
)


audio_file = open("speech.mp3", "rb")
transcript = client.audio.transcriptions.create(
  model="whisper",
  file=audio_file
)

支援的提供者

• OpenAI
• Azure
• Fireworks AI
• Groq
• Deepgram
• Mistral (Voxtral)
• OVHcloud AI Endpoints

---

備援

您可以為音訊轉錄設定備援，讓系統在主要模型失敗時自動改用不同模型重試。

Curl

Test with cURL and Fallbacks

curl --location 'http://0.0.0.0:4000/v1/audio/transcriptions' \
--header 'Authorization: Bearer sk-1234' \
--form 'file=@"gettysburg.wav"' \
--form 'model="groq/whisper-large-v3"' \
--form 'fallbacks[]="openai/whisper-1"'

OpenAI Python SDK

Test with OpenAI Python SDK and Fallbacks

from openai import OpenAI
client = OpenAI(
    api_key="sk-1234",
    base_url="http://0.0.0.0:4000"
)

audio_file = open("gettysburg.wav", "rb")
transcript = client.audio.transcriptions.create(
    model="groq/whisper-large-v3",
    file=audio_file,
    extra_body={
        "fallbacks": ["openai/whisper-1"]
    }
)

測試備援

您可以使用 mock_testing_fallbacks=true 來模擬失敗，以測試您的備援設定：

Curl

Test Fallbacks with Mock Testing

curl --location 'http://0.0.0.0:4000/v1/audio/transcriptions' \
--header 'Authorization: Bearer sk-1234' \
--form 'file=@"gettysburg.wav"' \
--form 'model="groq/whisper-large-v3"' \
--form 'fallbacks[]="openai/whisper-1"' \
--form 'mock_testing_fallbacks=true'

OpenAI Python SDK

Test Fallbacks with Mock Testing

from openai import OpenAI
client = OpenAI(
    api_key="sk-1234",
    base_url="http://0.0.0.0:4000"
)

audio_file = open("gettysburg.wav", "rb")
transcript = client.audio.transcriptions.create(
    model="groq/whisper-large-v3",
    file=audio_file,
    extra_body={
        "fallbacks": ["openai/whisper-1"],
        "mock_testing_fallbacks": True
    }
)