Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
☆12,281Apr 13, 2026Updated this week
Alternatives and similar repositories for OpenLLM
Users that are interested in OpenLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆76,536Updated this week
- LlamaIndex is the leading document agent and OCR platform☆48,601Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆43,478Updated this week
- Large Language Model Text Generation Inference☆10,830Mar 21, 2026Updated 3 weeks ago
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆8,580Updated this week
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,448Jun 2, 2025Updated 10 months ago
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆45,386Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,814Mar 23, 2026Updated 3 weeks ago
- A programming framework for agentic AI☆57,162Updated this week
- The agent engineering platform☆133,136Apr 11, 2026Updated last week
- A guidance language for controlling large language models.☆21,381Apr 10, 2026Updated last week
- LLM inference in C/C++☆103,237Updated this week
- The original local LLM interface. Text, vision, tool-calling, training. UI + API, 100% offline and private.☆46,493Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,815Apr 10, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Build AI Agents, Visually☆51,789Apr 11, 2026Updated last week
- Universal LLM Deployment Engine with ML Compilation☆22,414Apr 6, 2026Updated last week
- Universal memory layer for AI Agents☆52,987Updated this week
- DSPy: The framework for programming—not prompting—language models☆33,649Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆77,328May 27, 2025Updated 10 months ago
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,988Apr 8, 2026Updated last week
- Interact with your documents using the power of GPT, 100% privately, no data leaks☆57,201Feb 26, 2026Updated last month
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆169,151Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,471Jun 7, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,297Apr 10, 2026Updated last week
- Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products wi…☆39,090Jul 9, 2025Updated 9 months ago
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.5, DeepSeek, gpt-oss locally.☆61,312Updated this week
- 📋 A list of open LLMs available for commercial use.☆12,715Feb 13, 2025Updated last year
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ cl…☆9,822Updated this week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,978Jul 11, 2025Updated 9 months ago
- Structured Outputs☆13,657Mar 26, 2026Updated 3 weeks ago
- The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.☆58,070Apr 11, 2026Updated last week
- <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agent…☆17,445Jan 22, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,536Jul 16, 2023Updated 2 years ago
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆48,911Updated this week
- High-performance In-browser LLM Inference Engine☆17,740Apr 8, 2026Updated last week
- CLI platform to experiment with codegen. Precursor to: https://lovable.dev☆55,216May 14, 2025Updated 11 months ago
- Data infrastructure for AI☆27,396Updated this week
- 💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows☆12,395Apr 8, 2026Updated last week
- A natural language interface for computers☆63,151Updated this week