ποΈ Elasticsearch Logging with LiteLLM
Send your LLM requests, responses, costs, and performance data to Elasticsearch for analytics and monitoring using OpenTelemetry.
ποΈ Benchmark LLMs
Easily benchmark LLMs for a given question by viewing
ποΈ Reliability test Multiple LLM Providers with LiteLLM
* Quality Testing
ποΈ Evaluate LLMs - MLflow Evals, Auto Eval
Using LiteLLM with MLflow
ποΈ Benchmark LLMs - LM Harness, FastEval, Flask
LM Harness Benchmarks