llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both
☆59Nov 7, 2026Updated this week
Alternatives and similar repositories for llama-halo-hybrid
Users that are interested in llama-halo-hybrid are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆1,103Updated this week
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆27Sep 24, 2026Updated last month
- ☆14Sep 10, 2026Updated last month
- Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthrop…☆1,253Updated this week
- LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context☆99Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Self-hosted, browser-based AI dungeon RPG, fully local on an AMD Strix Halo APU: narrator + per-character agents on one local LLM (Gemma …☆28Jul 25, 2026Updated 3 months ago
- LLM inference in C/C++☆258Updated this week
- This is a mirror of the Strix Halo HomeLab wiki, to browse the wiki click on the link below☆74Aug 31, 2026Updated 2 months ago
- A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance☆236Updated this week
- llama.cpp fork for GSQ-quantized Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151): faster ROCm prefill, MTP and 4×256K chats with Q8_0 KV a…☆11Oct 11, 2026Updated 3 weeks ago
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆268Sep 7, 2026Updated 2 months ago
- Realtime dashboard for the Halogen LLM inference server☆23Oct 20, 2026Updated 2 weeks ago
- A high-performance RCCL / NCCL (ROCm Communication Collectives Library) plugin for Thunderbolt 5 that enables GPU-to-GPU communication ac…☆77Updated this week
- ROCm/AMD GPU benchmark suite for llama.cpp, whisper.cpp, PyTorch☆21Feb 4, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆28Aug 17, 2026Updated 2 months ago
- Flow control nodes for comfyUI, allowing for more diverse workflows☆13Apr 3, 2025Updated last year
- AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU,…☆37Updated this week
- LLM inference in C/C++☆43Updated this week
- Thick lens intraocular lens calculation formula toolbox written in Python, developed by Dr Gatinel's team, Anterior Segment and Refractiv…☆13May 15, 2024Updated 2 years ago
- Bring an idea. Leave with a working MVP. Lullabeast is a gated multi-agent pipeline that gets results from cheap open models. Run it with…☆16Jul 21, 2026Updated 3 months ago
- Qwen3.8-27B on a single RTX 4090 (sm_89): Cinference/NInfer port with MTP speculative decoding and K8V4 KV cache☆14Updated this week
- ☆12Apr 11, 2026Updated 6 months ago
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆86Sep 16, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆95Updated this week
- An extension for ComyUI that enables saving and loading node presets using the node's context menu☆14May 23, 2024Updated 2 years ago
- Claude Code skill for verifying OpenEvidence biomedical citations against PubMed with parallel accuracy scoring and audit reports☆14Apr 20, 2026Updated 6 months ago
- Serving Qwen3.8-27B at ~140 tok/s on 2x AMD R9700 in a Proxmox VM — with working GPU P2P (emulated PCIe switch + XanMod kernel + NDEBUG R…☆21Sep 16, 2026Updated last month
- Pi extension that adds CodeGraph-powered code intelligence tools to Pi Agent☆32Oct 31, 2026Updated last week
- ☆104Mar 8, 2026Updated 8 months ago
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆39Updated this week
- ☆177Sep 2, 2026Updated 2 months ago
- ☆20Sep 4, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Qwen 3.8 Next Flash toolbox utilizing pwilkin's strix-halo llama.cpp fork☆13Sep 16, 2026Updated last month
- rust binding for lean4☆12Jul 1, 2023Updated 3 years ago
- Enclosed chamber-type Delta 3d printer design☆11Aug 28, 2023Updated 3 years ago
- Collection of my nodes for ComyUI☆17Jan 24, 2026Updated 9 months ago
- ENGRAFT: write facts into an LLM's n-gram (Engram) memory table as a removable overlay: 100 facts in a 9 MB file, no weights touched, ver…☆60Sep 30, 2026Updated last month
- A Model Context Protocol (MCP) server that enables AI assistants to perform web searches using SearXNG, a privacy-respecting metasearch e…☆43Jan 22, 2026Updated 9 months ago
- ☆93Oct 23, 2026Updated 2 weeks ago