BerriAI / litellmLinks
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
☆33,588Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- DSPy: The framework for programming—not prompting—language models☆31,326Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆42,474Updated this week
- An LLM agent that conducts deep research (local and web) on any given topic and generates a long report with citations.☆24,813Updated 3 weeks ago
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆20,619Updated this week
- Build resilient language agents as graphs.☆23,113Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆30,284Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆20,772Updated 10 months ago
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆20,373Updated this week
- A programming framework for agentic AI☆53,353Updated 3 months ago
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆50,491Updated this week
- Universal memory layer for AI Agents☆45,257Updated last week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆119,997Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆56,860Updated this week
- The comple stack for Agent Engineering: framework, runtime and control plane.☆36,838Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆53,230Updated this week
- SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersec…☆18,218Updated 2 weeks ago
- Build Conversational AI in minutes ⚡️☆11,319Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆67,159Updated this week
- aider is AI pair programming in your terminal☆39,724Updated last week
- 🚀 The fast, Pythonic way to build MCP servers and clients☆21,842Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆21,694Updated last week
- ⏩ Ship faster with Continuous AI. Open-source CLI that can be used in TUI mode as a coding agent or Headless mode to run background agent…☆30,780Updated this week
- Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.☆159,175Updated this week
- GenAI Agent Framework, the Pydantic way☆14,232Updated this week
- Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRoute…☆32,994Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆46,229Updated this week
- 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN☆58,302Updated last week
- structured outputs for llms☆12,115Updated this week
- Open-source search and retrieval database for AI applications.☆25,369Updated this week
- Build AI Agents, Visually☆47,880Updated this week