Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
☆37,083Feb 27, 2026Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,234Updated this week
- Universal memory layer for AI Agents☆47,994Feb 23, 2026Updated last week
- LlamaIndex is the leading document agent and OCR platform☆47,210Updated this week
- A programming framework for agentic AI☆54,956Jan 22, 2026Updated last month
- DSPy: The framework for programming—not prompting—language models☆32,381Feb 24, 2026Updated last week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆44,662Updated this week
- Build, run, manage agentic software at scale.☆38,276Updated this week
- 🙌 OpenHands: AI-Driven Development☆68,459Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆22,415Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆125,513Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆53,029Updated this week
- aider is AI pair programming in your terminal☆41,062Feb 25, 2026Updated last week
- Build AI Agents, Visually☆49,461Updated this week
- 🦜🔗 The platform for reliable agents.☆127,809Updated this week
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,340Feb 24, 2026Updated last week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆58,536Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,370Updated this week
- structured outputs for llms☆12,428Feb 25, 2026Updated last week
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆163,632Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆10,748Feb 23, 2026Updated last week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆55,217Updated this week
- 🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data☆87,163Updated this week
- Production-ready platform for agentic workflow development.☆130,750Updated this week
- 🌐 Make websites accessible for AI agents. Automate tasks online with ease.☆79,028Updated this week
- A natural language interface for computers☆62,427Feb 9, 2026Updated 3 weeks ago
- ⏩ Source-controlled AI checks, enforceable in CI. Powered by the open-source Continue CLI☆31,532Updated this week
- 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN☆60,971Feb 25, 2026Updated last week
- An autonomous agent that conducts deep research on any data using any LLM providers.☆25,472Feb 21, 2026Updated last week
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…☆43,070Feb 25, 2026Updated last week
- Perplexica is an AI-powered answering engine.☆29,068Feb 13, 2026Updated 2 weeks ago
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆31,162Updated this week
- Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRoute…☆34,214Updated this week
- 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming☆64,648Jan 21, 2026Updated last month
- Get your documents ready for gen AI☆54,094Feb 24, 2026Updated last week
- LLM inference in C/C++☆96,322Updated this week
- Structured Outputs☆13,488Updated this week
- Open-source search and retrieval database for AI applications.☆26,418Updated this week
- Langflow is a powerful tool for building and deploying AI-powered agents and workflows.☆145,215Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆21,026Mar 11, 2025Updated 11 months ago