llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
☆282Oct 31, 2026Updated this week
Alternatives and similar repositories for ggrun
Users that are interested in ggrun are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama.cpp fork with additional SOTA quants and improved performance☆3,354Updated this week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,177Updated this week
- Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.☆113Oct 14, 2026Updated 2 weeks ago
- Pi compaction that reuses the server's prefix cache (vLLM / SGLang / llama.cpp Anthropic endpoints): no cold re-prefill, plus a warm-up s…☆23Oct 16, 2026Updated 2 weeks ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,772Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated last month
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,466Updated this week
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆6,144Updated this week
- Proxy for OpenAI☆16Sep 2, 2025Updated last year
- Build a software startup without writing code. Not vibe coding: a proven team workflow (requirements, design, test-first build, QA, relea…☆16Updated this week
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆183Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,967Updated this week
- Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware☆525Updated this week
- ☆18Oct 24, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Open-source framework for superagents.☆114Sep 11, 2026Updated last month
- ☆43May 4, 2026Updated 5 months ago
- Run autoresearch on any NVIDIA GPUs (Works on 2-4GB+ Cards)☆27Mar 22, 2026Updated 7 months ago
- ☆23Feb 17, 2026Updated 8 months ago
- Llama.cpp launcher with integrated huggingface☆75Oct 14, 2026Updated 2 weeks ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆171Sep 11, 2026Updated last month
- An agent that builds agents — closed-loop AI system that interviews, designs, tests, and ships standalone Python agents.☆14Jul 29, 2026Updated 3 months ago
- Open-source deep-work orchestrator: a frontier planner proposes one small epoch at a time; local models grind; deterministic gates verify…☆41Jul 11, 2026Updated 3 months ago
- A bare-bones GUI application for the local inference engine, llama.cpp. Built-in TPE optimiser to find the best flags for your system☆18Oct 15, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profi…☆154May 10, 2026Updated 5 months ago
- An offline coding agent for local models. One command sets up the best model your GPU can run, and on 24 GB+ RTX 30/40/50-series cards Qw…☆130Updated this week
- A lightweight, prompt-driven MCP web research server for high-quality LLM powered information extraction.☆139Apr 10, 2026Updated 6 months ago
- A harness optimized to smaller LLMs☆2,709Sep 18, 2026Updated last month
- An ongoing, collaborative meta-analysis about Human-AI-Interactions. We aggregate data and knowledge to build a non-abrasive, user-friend…☆114Aug 25, 2026Updated 2 months ago
- Verified multi-source distribution for local LLM weights☆16Oct 20, 2026Updated last week
- handwritten harness for AI, not vibecoded, everything is a module/plugin, tailor made for use with local models, tiny system prompt (arou…☆526Updated this week
- Push to Talk speech transcription app☆11Feb 8, 2026Updated 8 months ago
- Face search engine: 100% recall at 96x less memory than HNSW. Register photos, identify people from camera/video/images. AVX-512 + Rust. …☆20Jul 4, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆221Updated this week
- A TUI around llama.cpp for running, managing, and benchmarking local GGUF models and launching the pi coding agent against your local ser…☆32Updated this week
- Thinking blocks that open during generation: a gate decides when to think, a tree of candidate thoughts is explored, and the best one sta…☆18Oct 11, 2026Updated 2 weeks ago
- AI-assisted software development methodology for solo builders☆30Updated this week
- LLM inference in C/C++☆251Updated this week
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆61Aug 21, 2025Updated last year
- Qwen Code companion for Claude Code — delegate rescues, investigations, and code reviews to the qwen CLI from inside your Claude Code ses…☆11Apr 15, 2026Updated 6 months ago