BerriAI / litellmLinks
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆28,893Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆16,196Updated this week
- DSPy: The framework for programming—not prompting—language models☆28,156Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆38,101Updated this week
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆18,356Updated this week
- Build resilient language agents as graphs.☆18,611Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆9,314Updated last week
- Universal memory layer for AI Agents; Announcing OpenMemory MCP - local and secure memory management.☆39,808Updated this week
- SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersec…☆17,383Updated this week
- structured outputs for llms☆11,421Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆49,858Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆24,112Updated this week
- ⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI☆28,927Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆58,035Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,783Updated this week
- Build Conversational AI in minutes ⚡️☆10,639Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆20,404Updated 6 months ago
- High-performance runtime for multi-agent systems. Build, run and manage secure multi-agent systems in your cloud.☆33,093Updated this week
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆8,397Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆10,746Updated this week
- Structured Outputs☆12,560Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆44,256Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆23,424Updated 2 weeks ago
- Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRoute…☆30,047Updated this week
- Open-source search and retrieval database for AI applications.☆23,272Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆50,318Updated this week
- 🙌 OpenHands: Code Less, Make More☆63,461Updated this week
- An open-source RAG-based tool for chatting with your documents.☆24,052Updated 2 months ago
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆48,907Updated last week
- Build AI Agents, Visually☆43,569Updated this week
- Open source codebase powering the HuggingChat app☆9,145Updated last month