BerriAI / litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆17,500Updated this week
Alternatives and similar repositories for litellm:
Users that are interested in litellm are comparing it to the libraries listed below
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆10,131Updated this week
- The Memory layer for AI Agents☆24,628Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆38,980Updated this week
- DSPy: The framework for programming—not prompting—language models☆21,882Updated this week
- Agno is a lightweight library for building multi-modal Agents☆18,930Updated this week
- the AI-native open-source embedding database☆17,767Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38,093Updated this week
- Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! 🦥☆29,780Updated this week
- Letta (formerly MemGPT) is a framework for creating LLM services with memory.☆14,495Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆26,641Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆10,587Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆8,555Updated this week
- structured outputs for llms☆9,395Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆19,878Updated this week
- Structured Text Generation☆10,702Updated this week
- Build resilient language agents as graphs.☆9,076Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆18,709Updated 4 months ago
- Build Conversational AI in minutes ⚡️☆8,567Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆11,568Updated 2 weeks ago
- Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!☆5,607Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆25,920Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆39,522Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,789Updated this week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆16,206Updated this week
- Drag & drop UI to build your customized LLM flow☆35,136Updated this week
- ⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat…☆23,330Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆7,025Updated this week
- A guidance language for controlling large language models.☆19,654Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆7,822Updated this week
- Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.☆11,630Updated this week