TurboQuant KV cache compression for llama.cpp — HIP/ROCm port for AMD RDNA3 (gfx1100)
☆55Apr 26, 2026Updated 5 months ago
Alternatives and similar repositories for llama.cpp-turboquant-hip
Users that are interested in llama.cpp-turboquant-hip are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- World's first TurboQuant KV cache compression for llama.cpp on AMD ROCm (RX 9070 / gfx1201)☆21Apr 28, 2026Updated 5 months ago
- RDNA-native LLM inference engine in Rust.☆661Updated this week
- A way to visualize nginx config files☆10Nov 21, 2022Updated 3 years ago
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆778Updated this week
- Fork of turbo quant tom-tom and TurboQuant KV cache from domwox☆31Jul 7, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- TurboQuant 3-bit KV-cache quantization for llama.cpp☆54Jul 30, 2026Updated 2 months ago
- LLM inference in C/C++☆2,426Updated this week
- ☆43Apr 26, 2026Updated 5 months ago
- ☆19May 13, 2026Updated 5 months ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆80Sep 9, 2026Updated last month
- Automated Deployment of AMD ROCm 7.1.1 and PyTorch 2.11.0 (nightly@ROCm7.1) AI Stack for Ubuntu 22.04/24.04 on CDNA 3, RDNA4 and RDNA3. T…☆25May 5, 2026Updated 5 months ago
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆423Updated this week
- 🎭 Battle-tested plugins for Hermes Agent — zero core patches. Native vision bypass, multi-agent context injection, and more.☆53Jun 17, 2026Updated 3 months ago
- A dumb launcher to spawn swaylock and ensure it runs no matter what☆12Apr 30, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere,…☆35Dec 29, 2025Updated 9 months ago
- Freeze the screen of a Wayland compositor until a provided command exits☆27Updated this week
- Evolution process to find the best quant tensor weights to build the most optimal GGUF options for an AI model.☆49Sep 8, 2026Updated last month
- Agree is a Go package that makes it trivial to replicate any data structure using Raft.☆28Apr 10, 2016Updated 10 years ago
- Local-first memory layer for LLM apps and agents. Runs offline on Ollama, sentence-transformers and FAISS; OpenAI and Anthropic optional.…☆49Updated this week
- ☆202Oct 5, 2026Updated last week
- ☆68Updated this week
- A CLI that extracts structured context from your git history — for AI agents, PR descriptions, and standups.☆30Jun 19, 2026Updated 3 months ago
- Estimation and Prediction of Wet Season Calendar and Soil Water Balance for Agriculture☆16Feb 28, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A simple PCB adapter for use on a SuperFX or CX4 donor cart☆11Sep 21, 2025Updated last year
- This is a repository for the Geospatial Data Abstraction Library (GDAL) and it's applications, examples and discussions in the world of s…☆10May 28, 2023Updated 3 years ago
- Private-first, self-hostable knowledge base. Your data, your server, your control. No cloud, no telemetry, no trust required.☆22Oct 4, 2026Updated last week
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆281Updated this week
- Read Shapefiles☆11Mar 6, 2021Updated 5 years ago
- 🦉 OpenCode skill — error reflection & 5-Why root-cause learning agent☆17Sep 1, 2026Updated last month
- Create 'CREATE TABLE' and 'INSERT INTO...VALUES' SQL statements from R objects☆11Sep 11, 2022Updated 4 years ago
- Convert {sf} geometry to Rust native primitives☆13Jul 24, 2025Updated last year
- Intra- and Inter-Regional Similarity☆13Feb 10, 2026Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- AI Model Demand Offloading Allocator☆68Updated this week
- ☆24Jan 28, 2024Updated 2 years ago
- Conversational Agent for Twitter and Discord☆14Aug 24, 2026Updated last month
- Nested Dichotomy Logistic Regression Models☆10May 27, 2026Updated 4 months ago
- A style for equals assignment, based on the styler package☆13Apr 30, 2024Updated 2 years ago
- 🌳 rpix: R Interface for pixi☆15Updated this week
- 🚧 ✨ This package will help you create and build resume templates. 💯 It has simple and basic functionalities. But remains quite customiz…☆11Apr 23, 2024Updated 2 years ago