ποΈ Pre-fix Assistant Messages
Supported by:
ποΈ Predicted Outputs
| Property | Details |
ποΈ Prompt Compression (compress())
This feature is in beta. APIs and behavior may change before general availability.
ποΈ Trimming Input Messages
Use litellm.trim_messages() to ensure messages does not exceed a model's token limit or specified max_tokens
ποΈ Prompt Caching
Supported Providers:
ποΈ Prompt Formatting
LiteLLM automatically translates the OpenAI ChatCompletions prompt format, to other models. You can control this by setting a custom prompt template for a model as well.