BerriAI / litellmLinks
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆30,866Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆18,172Updated this week
- Multi-agent framework, runtime and control plane. Built for speed, privacy, and scale.☆35,065Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆40,175Updated last week
- Build resilient language agents as graphs.☆21,027Updated this week
- A programming framework for agentic AI☆51,575Updated last month
- Open-source search and retrieval database for AI applications.☆24,388Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.☆48,289Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆13,165Updated last week
- DSPy: The framework for programming—not prompting—language models☆30,008Updated this week
- GenAI Agent Framework, the Pydantic way☆13,276Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆45,140Updated last week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆115,188Updated this week
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆19,139Updated this week
- aider is AI pair programming in your terminal☆38,350Updated 2 weeks ago
- Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.☆155,718Updated this week
- 🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data☆67,598Updated this week
- ⏩ Ship faster with Continuous AI. Open-source CLI that can be used in TUI mode as a coding agent or Headless mode to run background agent…☆29,723Updated last week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆52,339Updated this week
- Universal memory layer for AI Agents☆43,147Updated this week
- 🚀 The fast, Pythonic way to build MCP servers and clients☆20,152Updated this week
- Convert PDF to markdown + JSON quickly with high accuracy☆29,799Updated last week
- Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRoute…☆31,564Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆9,840Updated this week
- An LLM agent that conducts deep research (local and web) on any given topic and generates a long report with citations.☆24,116Updated last week
- Build Conversational AI in minutes ⚡️☆10,995Updated this week
- structured outputs for llms☆11,827Updated this week
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆9,032Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆20,137Updated this week
- Build AI Agents, Visually☆46,513Updated this week
- Go ahead and axolotl questions☆10,753Updated last week