A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance
☆221Oct 29, 2026Updated this week
Alternatives and similar repositories for llama-cpp-rdna-boosts
Users that are interested in llama-cpp-rdna-boosts are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆28Updated this week
- The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyp…☆182Oct 13, 2026Updated 2 weeks ago
- ☆83Sep 10, 2026Updated last month
- DeepSeek-V4.1-Flash 1017 on 1x-2x RX 7900 XTX (gfx1100, ROCm/HIP): max optimizations☆39Oct 23, 2026Updated last week
- vLLM optimized for AMD☆27Oct 20, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AMD R9700 Tuned Stack for vLLM and ROCM10☆38Updated this week
- Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's☆136Oct 18, 2026Updated last week
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆28Oct 15, 2026Updated 2 weeks ago
- RDNA-native LLM inference engine in Rust.☆764Updated this week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆424Oct 22, 2026Updated last week
- An RDNA4 R9700 AI Pro ComfyUI patch for MiniMax H3 to speed up video generation.☆34Aug 8, 2026Updated 2 months ago
- Working on the fastest vllm path for AMD Radeon AI PRO R9700☆96Updated this week
- WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and…☆36Updated this week
- llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both☆57Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Serving Qwen3.8-27B at ~140 tok/s on 2x AMD R9700 in a Proxmox VM — with working GPU P2P (emulated PCIe switch + XanMod kernel + NDEBUG R…☆21Sep 16, 2026Updated last month
- ☆115Updated this week
- Fresh builds of llama.cpp with AMD ROCm™ acceleration☆798Updated this week
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆982Updated this week
- ☆31Aug 28, 2026Updated 2 months ago
- NEW ROCmfp4 format for llama.cpp☆158Jun 13, 2026Updated 4 months ago
- A minimal AI agent that gives an LLM a handful of tools, then gets out of the way.☆12Updated this week
- Universal cognitive engine for AI. Features autonomy, self-reflection, and continuous learning via the Nine Questions loop.☆14Jun 13, 2026Updated 4 months ago
- LLM inference in C/C++☆459Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Sep 8, 2026Updated last month
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆263Sep 7, 2026Updated last month
- ROCmFPX llama.cpp fork for Windows 🏆 — native build, headless OpenAI-compatible server & benchmarks. Tested on AMD Strix Halo (gfx1151),…☆11Aug 15, 2026Updated 2 months ago
- ☆36Updated this week
- ☆42Jun 12, 2026Updated 4 months ago
- ☆14Sep 10, 2026Updated last month
- Curated AMD GPU compatibility index and CLI for AI workloads☆33May 23, 2026Updated 5 months ago
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,177Updated this week
- LLM inference in C/C++☆42Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆221Updated this week
- Random AI notes for working with local models or playing around with random machine learning bits.☆63Jun 7, 2026Updated 4 months ago
- Official AMD catalog of AI agent skills. Empower your AI agents with AMD's optimized SW stack.☆470Updated this week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆37Sep 28, 2026Updated last month
- DeepSeek-V4 in C99, streamed off NVMe. Runs the 284B Flash checkpoint from 3.2 GB of RAM, 1.81 s/token with a GPU, verified against PyTor…☆23Aug 25, 2026Updated 2 months ago
- LLM inference in C/C++☆247Updated this week
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆91Updated this week