A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance
☆266Nov 17, 2026Updated this week
Alternatives and similar repositories for llama-cpp-rdna-boosts
Users that are interested in llama-cpp-rdna-boosts are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆30Updated this week
- ☆87Sep 10, 2026Updated 2 months ago
- ☆119Updated this week
- The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyp…☆195Oct 13, 2026Updated last month
- Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's☆175Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Almond: a multi-model engine for MoE and dense models on AMD RX 7900 XTX (ROCm/HIP) - DeepSeek-V4.1-Flash, GLM-5.3-Flash, Qwen3.8-Flash-N…☆55Updated this week
- Real-world percentile benchmark for LLM inference servers: 1% A/B resolution, offline HTML reports. I am now on X also: https://x.com/bku…☆90Oct 9, 2026Updated last month
- RDNA-native LLM inference engine in Rust.☆818Updated this week
- AMD R9700 Tuned Stack for vLLM and ROCM10☆40Nov 8, 2026Updated last week
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆27Nov 10, 2026Updated last week
- Working on the fastest vllm path for AMD Radeon AI PRO R9700☆116Updated this week
- WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and…☆39Updated this week
- vLLM optimized for AMD☆28Nov 3, 2026Updated 2 weeks ago
- An RDNA4 R9700 AI Pro ComfyUI patch for MiniMax H3 to speed up video generation.☆34Aug 8, 2026Updated 3 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Container driven LLM control for VLLM & llama models☆14Nov 11, 2026Updated last week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆434Oct 22, 2026Updated 3 weeks ago
- Fresh builds of llama.cpp with AMD ROCm™ acceleration☆827Updated this week
- llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both☆60Nov 7, 2026Updated last week
- ☆210Oct 5, 2026Updated last month
- Drop-in SageAttention for AMD RX 9070 / 9070 XT (RDNA4, gfx1201): custom HIP attention kernels for fp16 and bf16, 1.06-2.2x faster than P…☆16Nov 7, 2026Updated last week
- Serving Qwen3.8-27B at ~140 tok/s on 2x AMD R9700 in a Proxmox VM — with working GPU P2P (emulated PCIe switch + XanMod kernel + NDEBUG R…☆21Sep 16, 2026Updated 2 months ago
- Qwen3.8-27B EXL3 + DFlash2 speculative decoding on an AMD RX 7900 XTX (exllamav3-rocm): recipe, patches, benchmarks☆23Nov 2, 2026Updated 2 weeks ago
- Private Strata customizations for 9950x3d2+dual 7900xtx; upstream Niko1221/Strata☆125Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆37Sep 28, 2026Updated last month
- ☆98Updated this week
- The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary, with OpenAI-compatible APIs…☆1,205Updated this week
- A Rust inference engine currently targeting AMD R9700 GPU's. buymeacoffee.com/bkuyper☆69Updated this week
- LLM inference in C/C++☆94Nov 1, 2026Updated 2 weeks ago
- AMD Radeon 9700 AI PRO RDNA multi GPU Tools for llm/vLLM inference, tuning, overclocking, undervolting and LLM models benchmarking☆18Aug 15, 2026Updated 3 months ago
- NEW ROCmfp4 format for llama.cpp☆158Jun 13, 2026Updated 5 months ago
- LLM inference in C/C++☆482Nov 10, 2026Updated last week
- A minimal AI agent that gives an LLM a handful of tools, then gets out of the way.☆13Nov 8, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- LLM inference in C/C++☆22Sep 7, 2026Updated 2 months ago
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆71Sep 5, 2026Updated 2 months ago
- Auto-detect AMD GPUs on Windows/Linux and instantly get the correct HSA_OVERRIDE_GFX_VERSION for local AI (ROCm/HIP).☆17Nov 3, 2026Updated 2 weeks ago
- ☆32Aug 28, 2026Updated 2 months ago
- Fast fork of llama.cpp designed for Qwen3.8-Flash-Next☆459Updated this week
- vLLM on AMD RDNA4 (gfx1201 / RX 9070 XT-9070): clone-and-docker-compose-up, with a W4A8-FP8-WMMA MoE kernel☆14Jul 18, 2026Updated 4 months ago
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆25Sep 8, 2026Updated 2 months ago
Are these results useful?