ποΈ Getting Started Tutorial
End-to-End tutorial for LiteLLM Proxy to:
ποΈ Agent & MCP Gateway
4 items
ποΈ Config.yaml
3 items
ποΈ Setup & Deployment
16 items
ποΈ Admin UI
6 items
ποΈ Architecture
12 items
π All Endpoints (Swagger)
ποΈ Authentication
11 items
ποΈ Budgets + Rate Limits
12 items
ποΈ Caching
For OpenAI/Anthropic Prompt Caching, go here
ποΈ Memory Management
Store user preferences and feedback so your LLM remembers them across sessions. Scoped per user and team, with built-in access control.
ποΈ Guardrails
8 items
ποΈ Policies
4 items
ποΈ Create Custom Plugins
Modify requests, responses, and more
ποΈ LiteLLM Proxy CLI
The lite CLI is a command-line tool for managing your LiteLLM proxy
π Load Balancing, Routing, Fallbacks (Failover)
ποΈ A/B Testing - Traffic Mirroring
Traffic mirroring allows you to "mimic" production traffic to a secondary (silent) model for evaluation purposes. The silent model's response is gathered in the background and does not affect the latency or result of the primary request.
ποΈ Logging, Alerting, Metrics
5 items
ποΈ Making LLM Requests
6 items
ποΈ Model Access
6 items
ποΈ Secret Managers
10 items
ποΈ Spend Tracking
10 items
ποΈ Cost Optimization
5 items