GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B MoE). NPU prefill up to +28%, Flint 4.1k tok/s prefill, MTP / DFlash2 / auto speculative decoding up to 159 tok/s on structured text.
☆93Nov 3, 2026Updated this week
Alternatives and similar repositories for gufo
Users that are interested in gufo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fork of gufo-org/gufo with added support for Gemma models (31B and 26B, most quant types) and Deepseek V4.1 Flash (tested with ISTA-DASLa…☆15Updated this week
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆1,103Updated this week
- AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU,…☆37Updated this week
- Halowin Bubo: gufo for native Windows with AMD HIP, tuned for Strix Halo laptops☆22Updated this week
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆224Oct 25, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆15Oct 18, 2026Updated 3 weeks ago
- Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthrop…☆1,253Updated this week
- Rust LLM inference engine tuned for AMD Strix Halo (gfx1151): a fork of Strata with ggml/llama.cpp-derived HIP kernels. Five models on on…☆38Updated this week
- LLM inference in C/C++☆43Updated this week
- ☆18Updated this week
- Kyojin: open-source engine that runs 100 GB-class open models (GLM-5.3, Qwen3.8, DeepSeek V4.1) on one desktop machine. AMD Strix Halo, N…☆230Updated this week
- LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context☆99Updated this week
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆268Sep 7, 2026Updated 2 months ago
- llama.cpp fork tuned for Qwen 3.8 Flash-Next on AMD Strix Halo — RDNA3.5 kernel patches, true QSA sparse gather, working MTP, 27 GB engra…☆51Oct 14, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆431Oct 22, 2026Updated 2 weeks ago
- VigenFlow runs generative diffusion models fully on-device using the AMD Ryzen AI NPU.☆26Updated this week
- Local AI setup for AMD Strix Halo APU - Lemonade + Vulkan + kyuz0☆88Updated this week
- NEW ROCmfp4 format for llama.cpp☆159Jun 13, 2026Updated 4 months ago
- Qwen Image 2.1 Turbo Prediction and Strix Halo attention for ComfyUI☆18Sep 24, 2026Updated last month
- Browser-based operator console for managing and monitoring Lemonade on Linux inference servers.☆23Aug 27, 2026Updated 2 months ago
- llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both☆59Updated this week
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆85Updated this week
- ☆2,017Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- RDNA-native LLM inference engine in Rust.☆804Updated this week
- Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results…☆369Oct 21, 2026Updated 2 weeks ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆81Sep 9, 2026Updated last month
- Random AI notes for working with local models or playing around with random machine learning bits.☆63Jun 7, 2026Updated 5 months ago
- nvitop-style TUI frontend for amdgpu_top (AMDGPU + Strix Halo XDNA NPU)☆103Jul 23, 2026Updated 3 months ago
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆44Sep 17, 2026Updated last month
- ⚡ DROS™ VajraClaw (Hacker Edition): Free Multi-Agent Runtime Security & Docker Governance Gateway with W3C DID & <1μs Enforcement☆16Oct 14, 2026Updated 3 weeks ago
- LLM inference in C/C++☆27Oct 8, 2026Updated last month
- DR Pixel: Page-Native Deep Research with Vision-Language Models — benchmark, evaluation harness and training code☆38Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Unified terminal monitor for AMD Ryzen AI NPU (XDNA) + iGPU — live utilization for Strix Halo, where amd-smi comes up empty☆40Oct 18, 2026Updated 3 weeks ago
- LLM inference in C/C++☆41Updated this week
- Realtime dashboard for the Halogen LLM inference server☆23Oct 20, 2026Updated 2 weeks ago
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆28Aug 17, 2026Updated 2 months ago
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆86Sep 16, 2026Updated last month
- Qwen3.8-27B EXL3 + DFlash2 speculative decoding on an AMD RX 7900 XTX (exllamav3-rocm): recipe, patches, benchmarks☆21Updated this week
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆27Sep 24, 2026Updated last month