llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
☆281Oct 10, 2026Updated this week
Alternatives and similar repositories for ggrun
Users that are interested in ggrun are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,151Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆3,293Updated this week
- Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.☆113Aug 22, 2026Updated last month
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,375Updated this week
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,641Updated this week
- Proxy for OpenAI☆16Sep 2, 2025Updated last year
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,924Updated this week
- Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware☆523Sep 15, 2026Updated 3 weeks ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,911Updated this week
- vLLM Docker Container for the latest Qwen 27b☆52Sep 27, 2026Updated 2 weeks ago
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 5 months ago
- Llama.cpp launcher with integrated huggingface☆74Sep 8, 2026Updated last month
- Human-AI Document Standard — lightweight convention for AI-optimized technical documentation☆28Jul 9, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆180Updated this week
- Run autoresearch on any NVIDIA GPUs (Works on 2-4GB+ Cards)☆25Mar 22, 2026Updated 6 months ago
- ☆43May 4, 2026Updated 5 months ago
- ☆88Updated this week
- A harness optimized to smaller LLMs☆2,670Sep 18, 2026Updated 3 weeks ago
- SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profi…☆153May 10, 2026Updated 5 months ago
- AI-assisted software development methodology for solo builders☆30Updated this week
- Fulloch - The Fully Local Home Voice Assistant☆158Sep 23, 2026Updated 2 weeks ago
- Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent …☆108Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A lightweight, prompt-driven MCP web research server for high-quality LLM powered information extraction.☆140Apr 10, 2026Updated 6 months ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆170Sep 11, 2026Updated last month
- the composable multi-agent shell☆491Updated this week
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆61Aug 21, 2025Updated last year
- Open-source framework for superagents.☆114Sep 11, 2026Updated last month
- CTX - Context Runtime Engine for Coding Agents☆144May 11, 2026Updated 5 months ago
- Coding agent with cool features.☆19Aug 23, 2026Updated last month
- An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, a…☆3,459Updated this week
- Kon is a minimal coding agent (and also a highly opinionated one)☆354Oct 3, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆43Apr 26, 2026Updated 5 months ago
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆20Updated this week
- LLM inference in C/C++☆2,426Updated this week
- Using LLMs for iteratively exploring the solution search space at scale.☆740Updated this week
- Reproducible llama.cpp configs + per-category quality benches for Qwen3.6-27B on a single RTX 4090. Winners, dead ends, and the silent-co…☆24Apr 26, 2026Updated 5 months ago
- ☆23Feb 17, 2026Updated 7 months ago
- An ongoing, collaborative meta-analysis about Human-AI-Interactions. We aggregate data and knowledge to build a non-abrasive, user-friend…☆113Aug 25, 2026Updated last month