The fastest way to run Qwen3.8 27B on Strix Halo (gfx1151)
☆163Sep 14, 2026Updated 2 months ago
Alternatives and similar repositories for halogen-server
Users that are interested in halogen-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthrop…☆1,377Updated this week
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆227Oct 25, 2026Updated 3 weeks ago
- The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary, with OpenAI-compatible APIs…☆1,205Updated this week
- LLM inference in C/C++☆273Updated this week
- llama.cpp fork tuned for Qwen 3.8 Flash-Next on AMD Strix Halo — RDNA3.5 kernel patches, true QSA sparse gather, working MTP, 27 GB engra…☆51Oct 14, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Realtime dashboard for the Halogen LLM inference server☆30Nov 6, 2026Updated last week
- Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results…☆372Nov 9, 2026Updated last week
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆269Sep 7, 2026Updated 2 months ago
- ☆14Sep 10, 2026Updated 2 months ago
- Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a m…☆54Nov 9, 2026Updated last week
- ☆17Jun 10, 2026Updated 5 months ago
- ☆2,032Nov 7, 2026Updated last week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆434Oct 22, 2026Updated 3 weeks ago
- CIRU llama.cpp runtime for Qwen3.8-Flash-CIRU-STRIX-IU4 on AMD Strix Halo☆22Nov 10, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆37Sep 28, 2026Updated last month
- This will be the official ROCmFPX stack and studio☆54Oct 17, 2026Updated last month
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆27Sep 24, 2026Updated last month
- DeepSeek-V4-Flash inference for AMD Strix Halo☆28Sep 11, 2026Updated 2 months ago
- Strixfold: DeepSeek-V4.1-Flash on two AMD Strix Halo boxes over USB4. A HIP backend and Strix Halo kernels for TensorFold.☆76Updated this week
- A local commit gate: runs the linters your repo configures, and sends changed code to an LLM for review☆13Updated this week
- LLM inference in C/C++☆41Updated this week
- Reproducible, evidence-backed llama.cpp serving recipes for Strix Halo class machines — annotated parameters, ▏ multi-witness results, a…☆21Oct 3, 2026Updated last month
- ☆186Sep 2, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- vLLM optimized for AMD☆28Nov 3, 2026Updated 2 weeks ago
- Linux driver for the embedded controller on the Sixunited AXB35-02 board.☆87Oct 24, 2026Updated 3 weeks ago
- Clean-room AGPL-3.0 reimplementation of the halogen 0.1.3 inference engine for Qwen3.8-27B on AMD Strix Halo (gfx1151) — same wire protoc…☆18Sep 10, 2026Updated 2 months ago
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆33Updated this week
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆28Aug 17, 2026Updated 3 months ago
- ☆551Nov 2, 2026Updated 2 weeks ago
- Local AI setup for AMD Strix Halo APU - Lemonade + Vulkan + kyuz0☆88Nov 4, 2026Updated 2 weeks ago
- LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context☆106Updated this week
- experimental linux kernel modules and userspace drivers for RDMA-over-usb4/thunderbolt on consumer hardware☆76Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆43Sep 22, 2025Updated last year
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆42Sep 17, 2026Updated 2 months ago
- Random AI notes for working with local models or playing around with random machine learning bits.☆64Jun 7, 2026Updated 5 months ago
- ☆20Sep 4, 2025Updated last year
- ☆225Updated this week
- Unified terminal monitor for AMD Ryzen AI NPU (XDNA) + iGPU — live utilization for Strix Halo, where amd-smi comes up empty☆41Oct 18, 2026Updated last month
- AMD APU compatible Ollama. Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.☆16Aug 18, 2026Updated 3 months ago
Are these results useful?