BerriAI / litellmLinks
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆23,906Updated this week
Alternatives and similar repositories for litellm
Users that are interested in litellm are comparing it to the libraries listed below
Sorting:
- Build resilient language agents as graphs.☆14,228Updated this week
- the AI-native open-source embedding database☆20,459Updated this week
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆16,839Updated this week
- Full-stack framework for building Multi-Agent Systems with memory, knowledge and reasoning.☆28,213Updated this week
- DSPy: The framework for programming—not prompting—language models☆25,466Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆12,492Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆45,662Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆11,472Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆49,721Updated this week
- Memory for AI Agents; Announcing OpenMemory MCP - local and secure memory management.☆34,513Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.☆40,545Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆45,862Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆32,974Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆25,825Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆22,357Updated 2 weeks ago
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆21,835Updated last week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆42,374Updated this week
- Build Conversational AI in minutes ⚡️☆9,913Updated last week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆39,889Updated this week
- structured outputs for llms☆10,747Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆7,159Updated 2 months ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,151Updated this week
- aider is AI pair programming in your terminal☆34,260Updated this week
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆26,931Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,343Updated last week
- SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersec…☆16,261Updated this week
- Build AI Agents, Visually☆40,012Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆12,264Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆9,464Updated 2 weeks ago
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆14,829Updated 2 months ago