Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
☆12,174Mar 16, 2026Updated this week
Alternatives and similar repositories for OpenLLM
Users that are interested in OpenLLM are comparing it to the libraries listed below
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆73,479Updated this week
- LlamaIndex is the leading document agent and OCR platform☆47,753Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆39,597Updated this week
- Large Language Model Text Generation Inference☆10,803Jan 8, 2026Updated 2 months ago
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆8,520Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,428Jun 2, 2025Updated 9 months ago
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…☆43,827Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,765Mar 11, 2026Updated last week
- A programming framework for agentic AI☆55,908Updated this week
- The agent engineering platform☆129,503Mar 14, 2026Updated last week
- A guidance language for controlling large language models.☆21,346Mar 13, 2026Updated last week
- LLM inference in C/C++☆98,098Updated this week
- The original local LLM interface. Text, vision, tool-calling, training, and more. 100% offline.☆46,278Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,519Updated this week
- Build AI Agents, Visually☆50,762Mar 14, 2026Updated last week
- Universal LLM Deployment Engine with ML Compilation☆22,246Updated this week
- Universal memory layer for AI Agents☆50,147Updated this week
- DSPy: The framework for programming—not prompting—language models☆32,853Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆77,226May 27, 2025Updated 9 months ago
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,579Mar 13, 2026Updated last week
- Interact with your documents using the power of GPT, 100% privately, no data leaks☆57,183Feb 26, 2026Updated 3 weeks ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆165,557Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆54,096Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,479Jun 7, 2025Updated 9 months ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,228Mar 6, 2026Updated 2 weeks ago
- Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products wi…☆39,005Jul 9, 2025Updated 8 months ago
- 📋 A list of open LLMs available for commercial use.☆12,673Feb 13, 2025Updated last year
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, o…☆9,576Updated this week
- The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configration.☆56,228Mar 14, 2026Updated last week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,963Jul 11, 2025Updated 8 months ago
- Structured Outputs☆13,564Mar 9, 2026Updated last week
- <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agent…☆17,279Jan 22, 2025Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,537Jul 16, 2023Updated 2 years ago
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆46,408Updated this week
- High-performance In-browser LLM Inference Engine☆17,567Mar 13, 2026Updated last week
- CLI platform to experiment with codegen. Precursor to: https://lovable.dev☆55,223May 14, 2025Updated 10 months ago
- Open-source search and retrieval database for AI applications.☆26,660Updated this week
- 💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows☆12,291Mar 14, 2026Updated last week
- A natural language interface for computers☆62,780Feb 9, 2026Updated last month