BerriAI / litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆21,842Updated this week
Alternatives and similar repositories for litellm:
Users that are interested in litellm are comparing it to the libraries listed below
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆16,248Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆44,034Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆30,866Updated this week
- aider is AI pair programming in your terminal☆32,400Updated this week
- Build resilient language agents as graphs.☆12,179Updated this week
- DSPy: The framework for programming—not prompting—language models☆23,963Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,216Updated last week
- Memory for AI Agents; SOTA in AI Agent Memory, beating OpenAI Memory in accuracy by 26% - https://mem0.ai/research☆28,444Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆43,502Updated this week
- structured outputs for llms☆10,311Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆41,371Updated this week
- Structured Text Generation☆11,497Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆21,616Updated this week
- the AI-native open-source embedding database☆19,606Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆46,456Updated this week
- Agno is a lightweight library for building Agents with memory, knowledge, tools and reasoning.☆25,993Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆19,718Updated last month
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆26,010Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆24,899Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆42,313Updated this week
- Drag & drop UI to build your customized LLM flow☆37,797Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆11,059Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆21,240Updated this week
- Build Conversational AI in minutes ⚡️☆9,482Updated this week
- Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥☆37,861Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆9,025Updated last week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆11,078Updated this week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆17,222Updated this week
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆6,395Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆37,357Updated this week