Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.
☆263Sep 7, 2026Updated last month
Alternatives and similar repositories for q38rocm
Users that are interested in q38rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), …☆94Sep 24, 2026Updated last month
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆221Updated this week
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆982Updated this week
- Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthrop…☆1,136Updated this week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆424Oct 22, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- qwen3.8-flash-next on strix halo — 91g quant, 56 tok/s, 262k context, receipts included☆27Sep 24, 2026Updated last month
- llama.cpp fork tuned for Qwen 3.8 Flash-Next on AMD Strix Halo — RDNA3.5 kernel patches, true QSA sparse gather, working MTP, 27 GB engra…☆51Oct 14, 2026Updated 2 weeks ago
- Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results…☆366Oct 21, 2026Updated last week
- LLM inference in C/C++☆42Updated this week
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆27Aug 17, 2026Updated 2 months ago
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆41Sep 17, 2026Updated last month
- ☆2,005Oct 17, 2026Updated last week
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B M…☆86Updated this week
- Winning Qwen and DeepSeek setups for AMD Strix Halo: pinned Ansible recipes and matched benchmarks on a 128 GiB Ryzen AI Max+ 395 / Radeo…☆25Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Local AI setup for AMD Strix Halo APU - Lemonade + Vulkan + kyuz0☆87Oct 19, 2026Updated last week
- Gufo OCI Images for AMD Strix Halo☆23Updated this week
- RDNA-native LLM inference engine in Rust.☆764Updated this week
- Kyojin: open-source engine that runs the largest open models on one mini PC or one graphics card, about 2× faster than llama.cpp. AMD (RO…☆218Updated this week
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆84Updated this week
- A fast diffusion model engine for image generation and editing.☆38Updated this week
- ROCm/AMD GPU benchmark suite for llama.cpp, whisper.cpp, PyTorch☆21Feb 4, 2026Updated 8 months ago
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆26Sep 24, 2026Updated last month
- ☆540Oct 20, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This will be the official ROCmFPX stack and studio☆51Oct 17, 2026Updated last week
- llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both☆57Updated this week
- Linux driver for the embedded controller on the Sixunited AXB35-02 board.☆81Updated this week
- ☆257Oct 30, 2025Updated 11 months ago
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆37Sep 28, 2026Updated last month
- Random AI notes for working with local models or playing around with random machine learning bits.☆63Jun 7, 2026Updated 4 months ago
- Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a m…☆48Updated this week
- Tensor-parallel DeepSeek V4 Flash inference on dual AMD Strix Halo over OdinLink USB4/TB5 RDMA or Mellanox RoCE v2.☆23Sep 20, 2026Updated last month
- Unified terminal monitor for AMD Ryzen AI NPU (XDNA) + iGPU — live utilization for Strix Halo, where amd-smi comes up empty☆38Oct 18, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆56Sep 1, 2026Updated last month
- Clean-room AGPL-3.0 reimplementation of the halogen 0.1.3 inference engine for Qwen3.8-27B on AMD Strix Halo (gfx1151) — same wire protoc…☆18Sep 10, 2026Updated last month
- ☆93Updated this week
- ☆15Oct 18, 2026Updated last week
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆18Apr 26, 2026Updated 6 months ago
- NEW ROCmfp4 format for llama.cpp☆158Jun 13, 2026Updated 4 months ago
- Gufo officially supports Windows as of October 25, 2026. This fork will be winding down releases. Use my new GUI for official Gufo https:…☆24Updated this week