ποΈ Streaming + Async
| Feature | LiteLLM SDK | LiteLLM Proxy |
ποΈ Batching Completion()
LiteLLM allows you to:
ποΈ Structured Outputs (JSON Mode)
Quick Start
ποΈ 'Thinking' / 'Reasoning Content'
Requires LiteLLM v1.63.0+
Streaming, batching, structured outputs, and reasoning behavior
| Feature | LiteLLM SDK | LiteLLM Proxy |
LiteLLM allows you to:
Quick Start
Requires LiteLLM v1.63.0+