BerriAI / litellmLinks
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆28,040Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- aider is AI pair programming in your terminal☆37,048Updated 2 weeks ago
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆18,108Updated this week
- Open-source framework for building multi-agent systems with memory, knowledge and reasoning.☆32,484Updated this week
- DSPy: The framework for programming—not prompting—language models☆27,551Updated last week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆23,697Updated last week
- Build resilient language agents as graphs.☆17,746Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆49,169Updated last week
- Universal memory layer for AI Agents; Announcing OpenMemory MCP - local and secure memory management.☆38,749Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆56,349Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆36,136Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆15,529Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆20,300Updated 5 months ago
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆8,184Updated this week
- ⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI☆28,595Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆9,225Updated this week
- Structured Outputs☆12,462Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less…☆44,634Updated last week
- SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersec…☆17,168Updated this week
- structured outputs for llms☆11,278Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆108,434Updated this week
- Open-source search and retrieval database for AI applications.☆22,798Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆43,912Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,729Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆27,587Updated this week
- Build AI Agents, Visually☆43,136Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆23,228Updated this week
- The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data 🔥☆53,447Updated this week
- A natural language interface for computers☆60,358Updated 3 weeks ago
- The LLM Evaluation Framework☆10,472Updated this week
- 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.☆20,126Updated 4 months ago