使用 LiteLLM 建立的專案

📄️ 🤗 Smolagents

smolagents is a barebones library for agents. Agents write python code to call tools and orchestrate other agents.

📄️ mini-swe-agent

mini-swe-agent The 100 line AI agent that solves GitHub issues & more.

📄️ OpenAI Agents SDK

Use OpenAI Agents SDK with any LLM provider through LiteLLM Proxy.

📄️ Google ADK (Agent Development Kit)

Google ADK is an open-source, code-first Python framework for building, evaluating, and deploying sophisticated AI agents. While optimized for Gemini, ADK is model-agnostic and supports LiteLLM for using 100+ providers.

📄️ Agent Lightning

Agent Lightning is Microsoft's open-source framework for training and optimizing AI agents with Reinforcement Learning, Automatic Prompt Optimization, and Supervised Fine-tuning — with almost zero code changes.

📄️ Harbor

Harbor is a framework from the creators of Terminal-Bench for evaluating and optimizing agents and language models. It uses LiteLLM to call 100+ LLM providers.

📄️ CompatCanary

CompatCanary is an open-source conformance scanner for OpenAI-compatible endpoints. It sends deterministic probes through a LiteLLM proxy and records observed behavior for chat completions, streaming, tool calls, structured outputs, and the Responses API.

📄️ Microsoft GraphRAG

GraphRAG is a data pipeline and transformation suite that extracts meaningful, structured data from unstructured text using the power of LLMs. It uses a graph-based approach to RAG (Retrieval-Augmented Generation) that leverages knowledge graphs to improve reasoning over private datasets.

📄️ Docq.AI

A private and secure ChatGPT alternative that knows your business.

📄️ PDL

PDL - A YAML-based approach to prompt programming

📄️ OpenInterpreter

Open Interpreter lets LLMs run code on your computer to complete tasks.

📄️ 🐕 Elroy

Elroy is a scriptable AI assistant that remembers and sets goals.

📄️ dbally

Efficient, consistent and secure library for querying structured data with natural language. Query any database with over 100 LLMs ❤️ 🚅.

📄️ FastREPL

⚡Fast Run-Eval-Polish Loop for LLM Applications

📄️ PROMPTMETHEUS

🔥 PROMPTMETHEUS – Prompt Engineering IDE

📄️ Codium PR Agent

An AI-Powered 🤖 Tool for Automated Pull Request Analysis,

📄️ Prompt2Model

Prompt2Model - Generate Deployable Models from Instructions

📄️ SalesGPT

🤖 SalesGPT - Your Context-Aware AI Sales Assistant

📄️ Softgen

Softgen is an AI-powered platform that builds full-stack web apps from your plain instructions.

📄️ Quivr

🧠 Your Second Brain supercharged by Generative AI 🧠 Dump all your files and chat with your personal assistant on your files & more using GPT 3.5/4, Private, Anthropic, VertexAI, LLMs...

📄️ Langstream

Build robust LLM applications with true composability 🔗

📄️ Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

📄️ YiVal

🚀 Evaluate and Evolve.🚀 YiVal is an open source GenAI-Ops framework that allows you to manually or automatically tune and evaluate your AIGC prompts, retrieval configs and fine-tune the model params all at once with your preferred choices of test dataset generation, evaluation algorithms and improvement strategies.