Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
☆12,140Updated this week
Alternatives and similar repositories for OpenLLM
Users that are interested in OpenLLM are comparing it to the libraries listed below
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,234Updated this week
- LlamaIndex is the leading document agent and OCR platform☆47,210Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆37,083Updated this week
- Large Language Model Text Generation Inference☆10,774Jan 8, 2026Updated last month
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,414Jun 2, 2025Updated 8 months ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,731Feb 9, 2026Updated 2 weeks ago
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…☆43,070Updated this week
- A programming framework for agentic AI☆54,956Jan 22, 2026Updated last month
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,295Updated this week
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆8,472Updated this week
- A guidance language for controlling large language models.☆21,319Feb 13, 2026Updated 2 weeks ago
- 🦜🔗 The platform for reliable agents.☆127,192Updated this week
- LLM inference in C/C++☆95,726Updated this week
- Universal LLM Deployment Engine with ML Compilation☆22,061Feb 18, 2026Updated last week
- Universal memory layer for AI Agents☆47,994Updated this week
- The definitive Web UI for local AI, with powerful features and easy setup.☆46,091Feb 3, 2026Updated 3 weeks ago
- Build AI Agents, Visually☆49,310Updated this week
- DSPy: The framework for programming—not prompting—language models☆32,381Updated this week
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,214Jan 29, 2026Updated last month
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆77,157May 27, 2025Updated 9 months ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,182Feb 22, 2026Updated last week
- Interact with your documents using the power of GPT, 100% privately, no data leaks☆57,125Nov 13, 2024Updated last year
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆52,724Updated this week
- Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products wi…☆38,948Jul 9, 2025Updated 7 months ago
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, o…☆9,478Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆54,878Feb 21, 2026Updated last week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,943Jul 11, 2025Updated 7 months ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆163,632Updated this week
- <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agent…☆17,208Jan 22, 2025Updated last year
- High-performance In-browser LLM Inference Engine☆17,398Feb 18, 2026Updated last week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆44,662Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,476Jun 7, 2025Updated 8 months ago
- Structured Outputs☆13,456Feb 13, 2026Updated 2 weeks ago
- Open-source search and retrieval database for AI applications.☆26,269Updated this week
- 📋 A list of open LLMs available for commercial use.☆12,645Feb 13, 2025Updated last year
- 💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows☆12,210Feb 22, 2026Updated last week
- Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…☆29,102Updated this week
- A natural language interface for computers☆62,427Feb 9, 2026Updated 2 weeks ago
- CLI platform to experiment with codegen. Precursor to: https://lovable.dev☆55,208May 14, 2025Updated 9 months ago