Integrations
This section covers integrations with various tools and services that can be used with LiteLLM (either Proxy or SDK).
Observabilityβ
Track, debug, and analyze LLM calls with observability platforms.
πͺ’
Langfuse
LLM observability and analytics.
πΆ
Datadog
Metrics, traces, and dashboards.
π‘
OpenTelemetry
Vendor-neutral tracing.
π
LangSmith
LLM debugging and evaluation.
π₯
Arize / Phoenix
ML observability and evaluation.
π
Helicone
LLM request logging and analytics.
π
MLflow
Experiment tracking.
ποΈ
Weights & Biases
ML experiment tracking.
π
PostHog
Product analytics.
View all observability integrations β
Alerting & Monitoringβ
Set up alerts, metrics collection, and infrastructure monitoring.
π
Prometheus
Metrics collection and monitoring.
π¨
PagerDuty
Incident response and alerting.
π
Alerting
Slack, Teams, and webhook alerts.
π
Pyroscope
Continuous profiling.
Guardrail Providersβ
Add safety and content filtering to LLM calls.
π‘οΈ
Lakera AI
Prompt injection detection.
βοΈ
Azure Content Safety
Content moderation.
ποΈ
Bedrock Guardrails
AWS Bedrock safety.
π€
OpenAI Moderation
OpenAI content policy.
π
Secret Detection
Prevent credential leaks.
π΅οΈ
PII Masking
Mask sensitive data.
View all guardrail providers β
Policiesβ
Define and enforce usage policies across your LLM deployment.
π
Guardrail Policies
Policy-based guardrail rules.
π
Policy Flow Builder
Visual policy configuration.
π
Policy Templates
Pre-built policy templates.
AI Toolsβ
Connect LiteLLM to AI-powered coding and productivity tools.
π¬
OpenWebUI
Self-hosted ChatGPT-style interface.
π€
Claude Code
Use LiteLLM with Claude Code.
π±οΈ
Cursor
AI code editor integration.
π
GitHub Copilot
GitHub Copilot integration.
π»
OpenCode
Open source coding assistant.
π§
Retool Assist
Retool AI assistant.
Agent SDKsβ
Use LiteLLM with agent frameworks and SDKs.
π€
OpenAI Agents SDK
Build agents with OpenAI's SDK.
π§
Claude Agent SDK
Build agents with Anthropic's SDK.
π
Google ADK
Google Agent Development Kit.
π
CopilotKit
In-app AI copilots.
π§¬
Letta
Build stateful LLM agents with persistent memory.
ποΈ
LiveKit
Real-time voice and video AI agents.
Prompt Managementβ
Manage, version, and deploy prompts.
π
LiteLLM Prompt Management
Built-in prompt management.
π
Custom Prompt Management
Bring your own prompt store.
π₯
Arize Phoenix Prompts
Prompt management with Phoenix.
Manage with AI Agentsβ
Use AI agents to manage your LiteLLM deployment β create users, teams, keys, models, and more via natural language.