BerriAI / litellmLinks
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆27,105Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆35,461Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆14,790Updated this week
- Universal memory layer for AI Agents; Announcing OpenMemory MCP - local and secure memory management.☆37,908Updated this week
- Full-stack framework for building Multi-Agent Systems with memory, knowledge and reasoning.☆31,579Updated this week
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆17,750Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆9,097Updated this week
- Build Conversational AI in minutes ⚡️☆10,348Updated last week
- Build resilient language agents as graphs.☆16,932Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆43,574Updated this week
- Open-source search and retrieval database for AI applications.☆21,491Updated this week
- DSPy: The framework for programming—not prompting—language models☆26,994Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆12,292Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆54,323Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆48,479Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆27,173Updated this week
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆7,906Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆27,119Updated last month
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆47,701Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆23,385Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆20,227Updated 5 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆105,387Updated this week
- structured outputs for llms☆11,137Updated this week
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of rules, tools, and models☆28,210Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆22,888Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆10,261Updated this week
- 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.☆19,799Updated 4 months ago
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train gpt-oss, Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.☆43,376Updated this week
- aider is AI pair programming in your terminal☆36,527Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆16,010Updated this week
- Agent Framework / shim to use Pydantic with LLMs☆11,495Updated this week