☆2,795Jul 27, 2026Updated 3 months ago
Alternatives and similar repositories for ollm
Users that are interested in ollm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,253Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,910Updated this week
- [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, a…☆13,755Updated this week
- Parlant is an open platform for building customer-facing chat agents with AI. Describe how the agent should behave, and your coding agent…☆18,318Updated this week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆39,223Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official inference framework for 1-bit LLMs☆41,441Jul 27, 2026Updated 3 months ago
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,837Oct 26, 2026Updated last week
- AirLLM 2.8T LLM inference with single 4GB GPU☆41,525Updated this week
- The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU cluste…☆5,199Oct 26, 2026Updated last week
- "DeepCode: Open Agentic Coding (Agent Harness & Loop Engineering & Multi-Agent Orchestration)"☆16,781Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,455Oct 7, 2026Updated 3 weeks ago
- Build Real-Time Knowledge Graphs for AI Agents☆32,445Updated this week
- "RAG-Anything: All-in-One RAG Framework"☆24,391Updated this week
- The absolute trainer to light up AI agents.☆18,873Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The official repo for “Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting”, ACL, 2025.☆9,066Mar 25, 2026Updated 7 months ago
- Open-source context retrieval layer for AI agents☆6,547Jun 5, 2026Updated 4 months ago
- Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval…☆17,344Jul 14, 2026Updated 3 months ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,835May 28, 2026Updated 5 months ago
- Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.☆29,954Updated this week
- Recursive-Open-Meta-Agent v0.1 (Beta). A meta-agent framework to build high-performance multi-agent systems.☆5,190Feb 16, 2026Updated 8 months ago
- "AutoAgent: Fully-Automated and Zero-Code LLM Agent Framework"☆9,831Oct 16, 2025Updated last year
- Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations,…☆23,121Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,053Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Run frontier AI locally.☆48,151Updated this week
- Multilingual Document Layout Parsing in a Single Vision-Language Model☆9,184Mar 24, 2026Updated 7 months ago
- Get your documents ready for gen AI☆69,954Updated this week
- A system for agentic LLM-powered data processing and ETL☆4,187Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,342Updated this week
- Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK☆2,738Updated this week
- Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost …☆27,597Oct 22, 2026Updated last week
- The fullstack MCP framework to develop MCP Apps for ChatGPT / Claude & MCP Servers for AI Agents.☆10,837Updated this week
- Official Code of Memento: Fine-tuning LLM Agents without Fine-tuning LLMs☆2,668Oct 5, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆39,937Updated this week
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆7,104Oct 24, 2026Updated last week
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆16,056Updated this week
- On-device TTS model by Neuphonic☆6,339Jul 30, 2026Updated 3 months ago
- Open-source inference server and production cluster for all the models your agent needs.☆3,460Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆62,556Updated this week
- Agent Skills as a Memory Layer☆3,698Oct 24, 2026Updated last week