Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.
☆354Oct 3, 2026Updated last week
Alternatives and similar repositories for strix-halo-guide
Users that are interested in strix-halo-guide are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆56Sep 1, 2026Updated last month
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆53May 10, 2026Updated 5 months ago
- NEW ROCmfp4 format for llama.cpp☆159Jun 13, 2026Updated 3 months ago
- Home-enthusiast's guide to fine-tuning 27B+ LLMs on AMD Strix Halo (gfx1151, Ryzen AI MAX+ 395) — the patches and tuning to make Linux ma…☆30Jun 9, 2026Updated 4 months ago
- ☆1,984Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Local AI setup for AMD Strix Halo APU - Lemonade + Vulkan + kyuz0☆85Sep 16, 2026Updated 3 weeks ago
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆18Apr 26, 2026Updated 5 months ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆80Sep 9, 2026Updated last month
- Technical docs to help you make you Halo Strix WORK!☆71Sep 3, 2026Updated last month
- This is a mirror of the Strix Halo HomeLab wiki, to browse the wiki click on the link below☆73Aug 31, 2026Updated last month
- Linux driver for the embedded controller on the Sixunited AXB35-02 board.☆78Aug 20, 2026Updated last month
- ☆534Updated this week
- ☆90Oct 1, 2026Updated last week
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆78Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆773Updated this week
- This repository builds llama.cpp for Strix Halo devices.☆69Updated this week
- ☆27Mar 13, 2026Updated 6 months ago
- ☆102Mar 8, 2026Updated 7 months ago
- Random AI notes for working with local models or playing around with random machine learning bits.☆64Jun 7, 2026Updated 4 months ago
- Experimental support for many TTS/STT LLMs wrapped in a Wyoming API for consumption via Homeassistant☆44Sep 13, 2026Updated 3 weeks ago
- ☆29Jul 30, 2026Updated 2 months ago
- ☆88Updated this week
- Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…☆5,858Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆256Oct 30, 2025Updated 11 months ago
- ☆109Aug 28, 2026Updated last month
- Official repository of AMD Playbooks☆114Updated this week
- ROCm/AMD GPU benchmark suite for llama.cpp, whisper.cpp, PyTorch☆21Feb 4, 2026Updated 8 months ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆1,371Updated this week
- llama.cpp fork with AMD XDNA2 NPU backend for Ryzen AI MAX (npu5/XDNA2) — matrix multiply offload via XRT☆21Apr 1, 2026Updated 6 months ago
- ☆20Jul 21, 2026Updated 2 months ago
- RDNA-native LLM inference engine in Rust.☆659Updated this week
- ☆63Oct 3, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆69Sep 5, 2026Updated last month
- Curated AMD GPU compatibility index and CLI for AI workloads☆33May 23, 2026Updated 4 months ago
- Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.☆1,948Updated this week
- Lemonade Pi Agent CLI Plugin☆17Sep 12, 2026Updated 3 weeks ago
- A high-performance RCCL / NCCL (ROCm Communication Collectives Library) plugin for Thunderbolt 5 that enables GPU-to-GPU communication ac…☆72Sep 16, 2026Updated 3 weeks ago
- A converter for transferring gguf Q4_0, Q4_1 to FLM Q4NX☆43Sep 24, 2026Updated 2 weeks ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,907Updated this week