Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan plus ROCmFP4/MTP and ROCmFPX, parallel slots, with prefill/decode and quality metrics measured on this rig.
☆28Aug 17, 2026Updated 2 months ago
Alternatives and similar repositories for llama-vulkan-strix
Users that are interested in llama-vulkan-strix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆85Updated this week
- Experimental support for many TTS/STT LLMs wrapped in a Wyoming API for consumption via Homeassistant☆44Sep 13, 2026Updated last month
- Browser-based operator console for managing and monitoring Lemonade on Linux inference servers.☆23Updated this week
- Rust LLM inference engine tuned for AMD Strix Halo (gfx1151): a fork of Strata with ggml/llama.cpp-derived HIP kernels. Five models on on…☆39Updated this week
- Home-enthusiast's guide to fine-tuning 27B+ LLMs on AMD Strix Halo (gfx1151, Ryzen AI MAX+ 395) — the patches and tuning to make Linux ma…☆32Jun 9, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A fast diffusion model engine for image generation and editing.☆39Updated this week
- Fast vLLM on AMD Strix Halo: one docker command for Qwen, Gemma, LFM and more, up to 31x faster prefill and ~2x decode vs stock vLLM at l…☆21Updated this week
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆224Oct 25, 2026Updated 2 weeks ago
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆268Sep 7, 2026Updated 2 months ago
- ☆56Sep 1, 2026Updated 2 months ago
- Local AI setup for AMD Strix Halo APU - Lemonade + Vulkan + kyuz0☆88Updated this week
- NPU-accelerated speech transcription & speaker diarization on AMD Strix Halo: Whisper-v3-turbo on XDNA 2 + pyannote, OpenAI-compatible AP…☆14Aug 31, 2026Updated 2 months ago
- ☆62Aug 17, 2026Updated 2 months ago
- Random AI notes for working with local models or playing around with random machine learning bits.☆63Jun 7, 2026Updated 5 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Gufo OCI Images for AMD Strix Halo☆24Updated this week
- LLM inference in C/C++☆260Updated this week
- Known-good vLLM recipe: Qwen3.8-27B-Int8 + MTP speculative decoding on NVIDIA CMP 170HX 64GB (Hynix) — 84 tok/s, 262k ctx☆13Oct 8, 2026Updated last month
- ☆12Jan 20, 2026Updated 9 months ago
- A wide range of importing tools for converting third party reports into our internal format.☆14Updated this week
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆19Updated this week
- Run local LLMs on a Tesla V100-SXM2-16GB: prebuilt binaries, serve scripts, and setup for Windows and Linux (Qwen3 + Gemma 4, Claude Code…☆20Sep 1, 2026Updated 2 months ago
- ☆211Updated this week
- Dockernized ComfyUI with PyTorch & flash-attention for gfx1151 (AMD Strix Halo, Ryzen AI Max+ 395), relying on AMD's pre-built and pre-co…☆45Feb 25, 2026Updated 8 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆40Updated this week
- ☆24Jun 27, 2026Updated 4 months ago
- Reproducible, evidence-backed llama.cpp serving recipes for Strix Halo class machines — annotated parameters, ▏ multi-witness results, a…☆21Oct 3, 2026Updated last month
- ☆179Sep 2, 2026Updated 2 months ago
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆98Updated this week
- ☆27Mar 13, 2026Updated 7 months ago
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆1,123Updated this week
- Libegpu is a library for enumerating eGPU devices & enclosures.☆16Nov 24, 2025Updated 11 months ago
- ☆11Oct 1, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- A video editor for MiniMax H3 inside a single ComfyUI node: keyframes with independent strength dials, a fullscreen timeline, clip-to-cli…☆36Aug 20, 2026Updated 2 months ago
- An example project to demonstrate https://github.com/rvantonder/hack-parallel☆13May 18, 2020Updated 6 years ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆81Sep 9, 2026Updated 2 months ago
- Shebang line equivalent for Go☆12Jul 18, 2023Updated 3 years ago
- Update Hetzner Cloud firewall rules with current Cloudflare IP ranges☆13Updated this week
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B M…☆93Updated this week
Are these results useful?