Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan plus ROCmFP4/MTP and ROCmFPX, parallel slots, with prefill/decode and quality metrics measured on this rig.
☆27Aug 17, 2026Updated 2 months ago
Alternatives and similar repositories for llama-vulkan-strix
Users that are interested in llama-vulkan-strix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A fast diffusion model engine for image generation and editing.☆35Updated this week
- Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a m…☆37Updated this week
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆34Updated this week
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆83Sep 16, 2026Updated last month
- llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both☆51Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆258Sep 7, 2026Updated last month
- ☆74Jul 26, 2026Updated 2 months ago
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆82Updated this week
- High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), …☆90Sep 24, 2026Updated 3 weeks ago
- The systemd machine editor☆44Oct 5, 2026Updated 2 weeks ago
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆217Oct 9, 2026Updated last week
- ☆165Updated this week
- Experimental support for many TTS/STT LLMs wrapped in a Wyoming API for consumption via Homeassistant☆44Sep 13, 2026Updated last month
- The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)☆1,018Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Dockernized ComfyUI with PyTorch & flash-attention for gfx1151 (AMD Strix Halo, Ryzen AI Max+ 395), relying on AMD's pre-built and pre-co…☆46Feb 25, 2026Updated 7 months ago
- LLM inference in C/C++☆236Updated this week
- Theme Designer Pro for Open WebUI: palettes, Canvas FX, gradients and custom CSS, with a live preset gallery and a Studio.☆31Updated this week
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆811Updated this week
- collection of workflows and prompts used☆28Sep 7, 2026Updated last month
- LLM inference in C/C++☆42Updated this week
- llama.cpp fork tuned for Qwen 3.8 Flash-Next on AMD Strix Halo — RDNA3.5 kernel patches, true QSA sparse gather, working MTP, 27 GB engra…☆50Updated this week
- Custom node to load models in int8-(convrot) & now int4-/convrot) for speed gains on AMD GPU's with ROCM. (should work with nvidia gpus …☆47Updated this week
- This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …☆16Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Near-optimal vector quantization from Google's ICLR 2026 paper — 95% recall, 5x compression, zero preprocessing, pure Python FAISS replac…☆20Mar 28, 2026Updated 6 months ago
- ☆17Apr 7, 2024Updated 2 years ago
- Low-VRAM LoRA Training for Krea-2☆150Oct 1, 2026Updated 2 weeks ago
- ☆11Oct 1, 2025Updated last year
- A powerful & efficient browser agent that automates any task on the web☆24Aug 28, 2026Updated last month
- Run Tencent's HunyuanImage-3.0 (80B MoE) natively in ComfyUI on a 24 GB GPU: base, Instruct and Instruct-Distil, prompt rewriting, image …☆41Oct 9, 2026Updated last week
- Oasis Suite for ComfyUI - four all-in-one nodes: Image Oasis (multi-architecture image gen, LoRA stack, prompt enhancer, refiner, upscale…☆31Oct 6, 2026Updated last week
- Yandex.Phone kernel sources☆18Jan 17, 2019Updated 7 years ago
- An agent skill that turns AI coding assistants into Roblox development experts: Luau, engine APIs, architecture, anti-exploit security, a…☆52Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An example project to demonstrate https://github.com/rvantonder/hack-parallel☆13May 18, 2020Updated 6 years ago
- Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Mod…☆21Updated this week
- MCP server for Tailscale, backed by the tailscale CLI and control-plane REST API☆14Oct 10, 2026Updated last week
- ☆10Feb 22, 2022Updated 4 years ago
- Home-enthusiast's guide to fine-tuning 27B+ LLMs on AMD Strix Halo (gfx1151, Ryzen AI MAX+ 395) — the patches and tuning to make Linux ma…☆31Jun 9, 2026Updated 4 months ago
- Hopfield networks in Julia☆15May 5, 2015Updated 11 years ago
- Repository of Docker builds for Oracle databases.☆18Jul 3, 2023Updated 3 years ago