BerriAI / litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆13,971Updated this week
Related projects ⓘ
Alternatives and complementary repositories for litellm
- Letta (formerly MemGPT) is a framework for creating LLM services with memory.☆12,838Updated this week
- DSPy: The framework for programming—not prompting—language models☆18,885Updated this week
- Structured Text Generation☆9,487Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆6,598Updated this week
- Build Conversational AI in minutes ⚡️☆7,224Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆9,182Updated this week
- structured outputs for llms☆8,225Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆21,327Updated this week
- Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory☆18,263Updated this week
- LLM based autonomous agent that conducts local and web research on any topic and generates a comprehensive report with citations.☆14,955Updated this week
- Build resilient language agents as graphs.☆6,715Updated this week
- Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.☆10,079Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,487Updated this week
- A guidance language for controlling large language models.☆19,118Updated last week
- the AI-native open-source embedding database☆15,448Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆30,423Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆7,261Updated this week
- Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.☆10,666Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆18,840Updated this week
- Go ahead and axolotl questions☆7,930Updated this week
- [NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employ…☆13,723Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,653Updated this week
- Build AI Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.☆15,471Updated this week
- Large Action Model framework to develop AI Web Agents☆5,477Updated this week
- Drag & drop UI to build your customized LLM flow☆31,648Updated this week
- Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper☆4,660Updated last month
- DeepSeek Coder: Let the Code Write Itself☆6,842Updated 5 months ago
- A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆6,304Updated last week
- 🥷 Run AI-agents with an API☆5,321Updated last month
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆6,347Updated last week