LLM inference in C/C++
☆42Oct 17, 2026Updated this week
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆217Oct 9, 2026Updated last week
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆258Sep 7, 2026Updated last month
- Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a m…☆37Updated this week
- LLM inference in C/C++☆236Updated this week
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆811Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B and Qwen3.8 Flash-Next. NPU prefill +9% to +28%, MTP…☆58Updated this week
- The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)☆1,018Updated this week
- Random AI notes for working with local models or playing around with random machine learning bits.☆64Jun 7, 2026Updated 4 months ago
- Unified terminal monitor for AMD Ryzen AI NPU (XDNA) + iGPU — live utilization for Strix Halo, where amd-smi comes up empty☆38Oct 13, 2026Updated last week
- A fast diffusion model engine for image generation and editing.☆35Updated this week
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆83Sep 16, 2026Updated last month
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆417Sep 23, 2026Updated 3 weeks ago
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆41Sep 17, 2026Updated last month
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆37Sep 28, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆18Apr 26, 2026Updated 5 months ago
- This will be the official ROCmFPX stack and studio☆48Updated this week
- This is a mirror of the Strix Halo HomeLab wiki, to browse the wiki click on the link below☆73Aug 31, 2026Updated last month
- A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance☆199Updated this week
- Kyojin: the Yamz inference engine for AMD Strix Halo (ROCm, gfx1151), built on ExLlamaV3. Runs 300B-class MoE models on one 128 GB mini P…☆194Updated this week
- ☆23Updated this week
- Deterministic, read-only static auditor for GGUF models: behavioral chat-template backdoors + SSTI, tokenizer, config, and model-card sur…☆28Oct 1, 2026Updated 2 weeks ago
- Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Mod…☆21Updated this week
- ☆21Aug 17, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Technical docs to help you make you Halo Strix WORK!☆71Sep 3, 2026Updated last month
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆27Aug 17, 2026Updated 2 months ago
- LLM-first Three.js WebGPU scene and animation authoring with a persistent native viewport and typed MCP editing☆23Sep 4, 2026Updated last month
- Reverse engineering, documentation, and experimental firmware development for the original Polyend Tracker.☆42Updated this week
- Theme Designer Pro for Open WebUI: palettes, Canvas FX, gradients and custom CSS, with a live preset gallery and a Studio.☆31Updated this week
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆25Updated this week
- A shell script to automatically update or build llama.cpp with optimal GPU support. Supports cross-platform, smart architecture detection…☆17Aug 22, 2026Updated last month
- MCP server that shrinks logs, JSON, docs and web pages before your AI reads them. Offline, deterministic, ~3ms, no API key. 66% fewer tok…☆25Updated this week
- This repository was created to organize pieces of aGPL licensed jasperreports server code folowing the deletion of the official repositoi…☆12Aug 25, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆89Updated this week
- High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), …☆90Sep 24, 2026Updated 3 weeks ago
- Linux driver for the embedded controller on the Sixunited AXB35-02 board.☆79Aug 20, 2026Updated last month
- Goal Driven Development - Transform software development from task execution to outcome achievement with goal-driven development methodo…☆14Oct 1, 2026Updated 2 weeks ago
- Kotai is a fully local, zero-cost voice assistant that combines the power of Kyutai TTS/STT, LiveKit, and local LLMs to create natural co…☆10Jul 14, 2025Updated last year
- collection of workflows and prompts used☆28Sep 7, 2026Updated last month
- Custom node to load models in int8-(convrot) & now int4-/convrot) for speed gains on AMD GPU's with ROCM. (should work with nvidia gpus …☆47Updated this week