Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; DeepSeek V4.1 Flash across two nodes over USB4 with an optional RTX PRO. Speculative decoding bit-identical to greedy, up to 255 tok/s on coding chat. MiniMax and GLM next.
☆21Nov 11, 2026Updated this week
Alternatives and similar repositories for strix-halo-engine-lab
Users that are interested in strix-halo-engine-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RDMA fork version of Strix Halo inference engine. Qwen Flash Next Q4_K_XL: >2100pp …☆26Nov 4, 2026Updated last week
- Two-rank tensor-parallel LLM serving over USB4v2 between AMD Strix Halo hosts: a custom Linux thunderbolt stream transport, self-healing …☆17Updated this week
- Strixfold: DeepSeek-V4.1-Flash on two AMD Strix Halo boxes over USB4. A HIP backend and Strix Halo kernels for TensorFold.☆42Updated this week
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆22Oct 16, 2026Updated 3 weeks ago
- Control and interact with Oh My Pi remotely through Telegram, with persistent sessions, reliable message delivery, and workspace-aware ta…☆13Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast vLLM on AMD Strix Halo: one docker command for Qwen, Gemma, LFM and more, up to 31x faster prefill and ~2x decode vs stock vLLM at l…☆21Updated this week
- A deterministic inference engine for DeepSeek-V4.1-Flash 1017 and Qwen3.8-Flash-Next on a single AMD Strix Halo 128 GB☆21Updated this week
- ☆18Nov 4, 2026Updated last week
- Libegpu is a library for enumerating eGPU devices & enclosures.☆16Nov 24, 2025Updated 11 months ago
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆28Aug 17, 2026Updated 2 months ago
- Local AI harness for coding agents: detects your GPU and RAM, recommends an engine and model, sizes limits to your context. Any OpenAI-co…☆38Updated this week
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆86Sep 16, 2026Updated last month
- Persistent project-scoped knowledge base for Claude Code and Codex: quick and deep research depths, contrarian pass, source-independence …☆15Jul 23, 2026Updated 3 months ago
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Known-good vLLM recipe: Qwen3.8-27B-Int8 + MTP speculative decoding on NVIDIA CMP 170HX 64GB (Hynix) — 84 tok/s, 262k ctx☆13Oct 8, 2026Updated last month
- ☆22Jun 30, 2026Updated 4 months ago
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆225Oct 25, 2026Updated 2 weeks ago
- Rust LLM inference engine tuned for AMD Strix Halo (gfx1151): a fork of Strata with ggml/llama.cpp-derived HIP kernels. Five models on on…☆40Updated this week
- Run local LLMs on a Tesla V100-SXM2-16GB: prebuilt binaries, serve scripts, and setup for Windows and Linux (Qwen3 + Gemma 4, Claude Code…☆20Sep 1, 2026Updated 2 months ago
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆19Updated this week
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆19Apr 26, 2026Updated 6 months ago
- LLM inference in C/C++☆261Updated this week
- Kyojin: open-source engine that runs 100 GB-class open models (GLM-5.3, Qwen3.8, DeepSeek V4.1) on one desktop machine. AMD Strix Halo, N…☆235Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆53May 10, 2026Updated 6 months ago
- NPU-accelerated speech transcription & speaker diarization on AMD Strix Halo: Whisper-v3-turbo on XDNA 2 + pyannote, OpenAI-compatible AP…☆14Aug 31, 2026Updated 2 months ago
- reverse engineering https://pomofocus.io/☆10Feb 11, 2021Updated 5 years ago
- llama.cpp setup on dedicated AMD Strix Halo machine☆14Jul 26, 2026Updated 3 months ago
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆50Updated this week
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆1,142Updated this week
- Home-enthusiast's guide to fine-tuning 27B+ LLMs on AMD Strix Halo (gfx1151, Ryzen AI MAX+ 395) — the patches and tuning to make Linux ma…☆32Jun 9, 2026Updated 5 months ago
- MiMo-V2.5 Omni TP=2 on 2x DGX Spark · 1M context · NVFP4 4-bit KV (~1.97M-token KV pool @ 1M, ~30 tok/s) · 69-eval: thinking-OFF 97.8 bea…☆39Jul 13, 2026Updated 3 months ago
- ☆24Jun 27, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Production-speed compact Dynamic Memory Sparsification (DMS) for KV cache compression☆27Oct 27, 2026Updated 2 weeks ago
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆85Updated this week
- ☆11Aug 30, 2023Updated 3 years ago
- Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthrop…☆1,300Updated this week
- This is a mirror of the Strix Halo HomeLab wiki, to browse the wiki click on the link below☆74Aug 31, 2026Updated 2 months ago
- ☆17Oct 4, 2026Updated last month
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆44Sep 17, 2026Updated last month
Are these results useful?