BerriAI / litellmLinks
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆24,658Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆33,432Updated this week
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆27,337Updated this week
- the AI-native open-source embedding database☆20,659Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.☆41,118Updated this week
- Build resilient language agents as graphs.☆14,845Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆13,170Updated this week
- Build AI Agents, Visually☆40,882Updated this week
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆17,080Updated this week
- DSPy: The framework for programming—not prompting—language models☆25,821Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆22,123Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆26,164Updated last week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆42,633Updated this week
- Memory for AI Agents; Announcing OpenMemory MCP - local and secure memory management.☆35,516Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆50,864Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆46,746Updated this week
- An open-source RAG-based tool for chatting with your documents.☆22,715Updated 2 weeks ago
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆46,610Updated this week
- structured outputs for llms☆10,824Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆11,759Updated this week
- A list of AI autonomous agents☆19,061Updated 4 months ago
- A guidance language for controlling large language models.☆20,399Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆100,205Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆41,443Updated this week
- 🦜🔗 Build context-aware reasoning applications☆110,444Updated this week
- Structured Text Generation☆11,963Updated this week
- Build Conversational AI in minutes ⚡️☆10,054Updated this week
- aider is AI pair programming in your terminal☆35,002Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆45,896Updated last week
- The official Python SDK for Model Context Protocol servers and clients☆15,421Updated this week
- A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.☆17,361Updated last week