BerriAI / litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
☆16,235Updated this week
Alternatives and similar repositories for litellm:
Users that are interested in litellm are comparing it to the libraries listed below
- Build resilient language agents as graphs.☆8,082Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆9,785Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆7,839Updated this week
- Letta (formerly MemGPT) is a framework for creating LLM services with memory.☆13,996Updated this week
- Build Conversational AI in minutes ⚡️☆7,691Updated this week
- structured outputs for llms☆8,909Updated this week
- SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensiv…☆14,188Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆37,558Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆11,197Updated this week
- DSPy: The framework for programming—not prompting—language models☆21,018Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆6,639Updated this week
- LLM based autonomous agent that conducts local and web research on any topic and generates a comprehensive report with citations.☆15,736Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆24,745Updated this week
- the AI-native open-source embedding database☆17,023Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆21,693Updated this week
- aider is AI pair programming in your terminal☆24,970Updated this week
- Finetune Llama 3.3, Mistral, Phi-4, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory☆20,611Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆38,057Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆33,809Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,688Updated this week
- Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.☆10,380Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆22,748Updated this week
- The Memory layer for your AI apps☆23,953Updated this week
- A list of AI autonomous agents☆13,154Updated last week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆17,712Updated 3 months ago
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆18,641Updated this week
- Structured Text Generation☆10,350Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆7,430Updated this week
- ☆9,445Updated 5 months ago
- Build multi-modal Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.☆17,869Updated this week