BerriAI / litellmLinks
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
☆32,750Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆41,609Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆19,644Updated this week
- Universal memory layer for AI Agents☆44,484Updated last week
- A programming framework for agentic AI☆52,772Updated 2 months ago
- Build resilient language agents as graphs.☆22,350Updated this week
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆19,588Updated last week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆45,923Updated this week
- Build AI Agents, Visually☆47,406Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.☆49,644Updated this week
- The unified stack for multi-agent systems.☆36,070Updated last week
- Open-source search and retrieval database for AI applications.☆25,035Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆13,472Updated this week
- structured outputs for llms☆12,007Updated this week
- ⏩ Ship faster with Continuous AI. Open-source CLI that can be used in TUI mode as a coding agent or Headless mode to run background agent…☆30,437Updated this week
- SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersec…☆18,076Updated this week
- DSPy: The framework for programming—not prompting—language models☆30,883Updated this week
- Structured Outputs☆13,131Updated last week
- Build Conversational AI in minutes ⚡️☆11,206Updated 2 weeks ago
- Open Source AI Platform - AI Chat with advanced features that works with every LLM☆16,866Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆56,239Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆10,110Updated last week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆20,716Updated 9 months ago
- Supercharge Your LLM Application Evaluations 🚀☆11,824Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,011Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆118,191Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆65,845Updated this week
- 🦜🔗 The platform for reliable agents.☆122,096Updated last week
- A guidance language for controlling large language models.☆21,008Updated last week
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆9,546Updated this week
- 🙌 OpenHands: AI-Driven Development☆65,792Updated this week