The fastest way to run Qwen3.8 27B on Strix Halo (gfx1151)
☆144Sep 14, 2026Updated last month
Alternatives and similar repositories for halogen-server
Users that are interested in halogen-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthrop…☆1,136Updated this week
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆221Updated this week
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆982Updated this week
- LLM inference in C/C++☆247Updated this week
- llama.cpp fork tuned for Qwen 3.8 Flash-Next on AMD Strix Halo — RDNA3.5 kernel patches, true QSA sparse gather, working MTP, 27 GB engra…☆51Oct 14, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Sep 10, 2026Updated last month
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆424Oct 22, 2026Updated last week
- Gufo OCI Images for AMD Strix Halo☆23Updated this week
- This will be the official ROCmFPX stack and studio☆51Oct 17, 2026Updated last week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆37Sep 28, 2026Updated last month
- CIRU llama.cpp runtime for Qwen3.8-Flash-CIRU-STRIX-IU4 on AMD Strix Halo☆21Sep 28, 2026Updated last month
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B M…☆86Updated this week
- DeepSeek V4 Flash 284B on AMD Strix Halo (gfx1151) — up to 32 tok/s decode & ~250 tok/s prefill via ROCmFPX, DSpark & ROCm 7.2☆19Aug 28, 2026Updated 2 months ago
- Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results…☆366Oct 21, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A local commit gate: runs the linters your repo configures, and sends changed code to an LLM for review☆13Updated this week
- ☆2,005Oct 17, 2026Updated last week
- Reproducible, evidence-backed llama.cpp serving recipes for Strix Halo class machines — annotated parameters, ▏ multi-witness results, a…☆21Oct 3, 2026Updated 3 weeks ago
- Run Qwen3.8-Flash-Next on a single AMD Strix Halo using Halogen Flash Server☆24Oct 15, 2026Updated 2 weeks ago
- ☆104Mar 8, 2026Updated 7 months ago
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆26Sep 24, 2026Updated last month
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆27Aug 17, 2026Updated 2 months ago
- An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next.…☆121Updated this week
- ☆172Sep 2, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆182Updated this week
- ☆64Jul 27, 2026Updated 3 months ago
- Local AI setup for AMD Strix Halo APU - Lemonade + Vulkan + kyuz0☆87Oct 19, 2026Updated last week
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆86Sep 16, 2026Updated last month
- AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU,…☆36Updated this week
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆41Sep 17, 2026Updated last month
- Realtime dashboard for the Halogen LLM inference server☆16Oct 20, 2026Updated last week
- ☆540Oct 20, 2026Updated last week
- ☆43Sep 22, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆93Oct 23, 2026Updated last week
- World's first AMD NPU driver for TUXEDO laptops - Enable AI acceleration on Linux☆51Aug 5, 2025Updated last year
- Unified terminal monitor for AMD Ryzen AI NPU (XDNA) + iGPU — live utilization for Strix Halo, where amd-smi comes up empty☆38Oct 18, 2026Updated last week
- ☆20Sep 4, 2025Updated last year
- llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both☆57Updated this week
- WMMA GEMM in ROCm for RDNA GPUs☆19Sep 1, 2026Updated last month
- Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a m…☆48Updated this week