TurboQuant KV cache compression for llama.cpp — HIP/ROCm port for AMD RDNA3 (gfx1100)
☆55Apr 26, 2026Updated 4 months ago
Alternatives and similar repositories for llama.cpp-turboquant-hip
Users that are interested in llama.cpp-turboquant-hip are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- World's first TurboQuant KV cache compression for llama.cpp on AMD ROCm (RX 9070 / gfx1201)☆21Apr 28, 2026Updated 4 months ago
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆25Jun 23, 2026Updated 3 months ago
- Frequency-based KV cache pruning for llama.cpp — 25% cache reduction, improved PPL at long context. GPU compaction kernel for HIP/ROCm.☆16Apr 18, 2026Updated 5 months ago
- RDNA-native LLM inference engine in Rust.☆635Updated this week
- A way to visualize nginx config files☆10Nov 21, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆745Updated this week
- TurboQuant 3-bit KV-cache quantization for llama.cpp☆56Jul 30, 2026Updated last month
- LLM inference in C/C++☆2,396Updated this week
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆76Sep 9, 2026Updated 2 weeks ago
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆414Updated this week
- 🎭 Battle-tested plugins for Hermes Agent — zero core patches. Native vision bypass, multi-agent context injection, and more.☆52Jun 17, 2026Updated 3 months ago
- Read-Only source code mirror, Proxmox uses mailing list workflow for development.☆27Aug 21, 2026Updated last month
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere,…☆35Dec 29, 2025Updated 8 months ago
- Evolution process to find the best quant tensor weights to build the most optimal GGUF options for an AI model.☆46Sep 8, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆199Sep 2, 2026Updated 3 weeks ago
- ☆60Updated this week
- Advanced interoperability middleware for GPGPU acceleration. Facilitates cross vendor hardware abstraction and API translation for parall…☆103Sep 8, 2026Updated 2 weeks ago
- Estimation and Prediction of Wet Season Calendar and Soil Water Balance for Agriculture☆16Feb 28, 2025Updated last year
- LTX-2 is the first DiT-based audio-video foundation model that contains all core capabilities of modern video generation in one model: sy…☆31Sep 9, 2026Updated 2 weeks ago
- Long Long Term Memory Neural Net Cells☆10Jan 25, 2022Updated 4 years ago
- Fast color lookup for R☆10Feb 17, 2025Updated last year
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆275Updated this week
- 🦉 OpenCode skill — error reflection & 5-Why root-cause learning agent☆17Sep 1, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Create equal-area histograms with 'ggplot2'☆10Jul 23, 2023Updated 3 years ago
- Check Safety of SSH Public Keys☆12Oct 8, 2022Updated 3 years ago
- Trace Function Parameter Types in R☆17Sep 1, 2026Updated 3 weeks ago
- The Wetland DEM Ponding Model☆13Sep 22, 2021Updated 5 years ago
- Nested Dichotomy Logistic Regression Models☆10May 27, 2026Updated 3 months ago
- 🌳 rpix: R Interface for pixi☆15Oct 15, 2025Updated 11 months ago
- 🚧 ✨ This package will help you create and build resume templates. 💯 It has simple and basic functionalities. But remains quite customiz…☆11Apr 23, 2024Updated 2 years ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆1,329Updated this week
- 🏢 A R package with {officer} helper functions.☆13Sep 16, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Generic Coordinate Transformation Library ('PROJ') C API☆16Mar 6, 2024Updated 2 years ago
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆474Aug 17, 2026Updated last month
- repo for AMD ROCDXG project☆140Aug 29, 2026Updated 3 weeks ago
- libqrencode 3.4.4 Visual Studio Build☆10Dec 5, 2015Updated 10 years ago
- High-level combined tracebacks☆15Sep 14, 2026Updated last week
- Flood Map Tile Server built with FastAPI and TiTiler☆11May 1, 2023Updated 3 years ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆168Sep 11, 2026Updated last week