TurboQuant KV cache compression for llama.cpp — HIP/ROCm port for AMD RDNA3 (gfx1100)
☆55Apr 26, 2026Updated 4 months ago
Alternatives and similar repositories for llama.cpp-turboquant-hip
Users that are interested in llama.cpp-turboquant-hip are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- World's first TurboQuant KV cache compression for llama.cpp on AMD ROCm (RX 9070 / gfx1201)☆20Apr 28, 2026Updated 4 months ago
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆25Jun 23, 2026Updated 2 months ago
- Frequency-based KV cache pruning for llama.cpp — 25% cache reduction, improved PPL at long context. GPU compaction kernel for HIP/ROCm.☆16Apr 18, 2026Updated 4 months ago
- RDNA-native LLM inference engine in Rust.☆591Updated this week
- A way to visualize nginx config files☆10Nov 21, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TurboQuant 3-bit KV-cache quantization for llama.cpp☆56Jul 30, 2026Updated last month
- Fast fp16-fp8 mixed precision matmul on RDNA3/3.5 GPUs without native fp8☆37Updated this week
- [C++] Latest Visual-Studio 2005/2008 Project Of JKDefrag Source-Code. Fixed (Will Compile 100%)☆10Jun 20, 2022Updated 4 years ago
- LLM inference in C/C++☆2,341Updated this week
- ☆16Updated this week
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆70Updated this week
- Automated Deployment of AMD ROCm 7.1.1 and PyTorch 2.11.0 (nightly@ROCm7.1) AI Stack for Ubuntu 22.04/24.04 on CDNA 3, RDNA4 and RDNA3. T…☆25May 5, 2026Updated 3 months ago
- llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% t…☆369Aug 6, 2026Updated 3 weeks ago
- Read-Only source code mirror, Proxmox uses mailing list workflow for development.☆27Aug 21, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- My wezterm config☆17Feb 18, 2023Updated 3 years ago
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere,…☆35Dec 29, 2025Updated 8 months ago
- Tiny HEVC Baseline codec, simple beasline of HEVC reference model☆20Aug 10, 2012Updated 14 years ago
- ☆18Sep 19, 2011Updated 14 years ago
- ☆45Updated this week
- Monorepo for sharing my most commonly used Nix expressions between projects.☆30Updated this week
- A C++ tool for decrypting the Switch's flash memory (public domain, thanks to rajkosto for providing guidance)☆11Apr 30, 2018Updated 8 years ago
- A basic command-line ROM set manager.☆10Dec 7, 2022Updated 3 years ago
- Inspired by refind-btrfs, this version is a single static binary that supports accurate auto-detection of boot options and extends some f…☆25Jul 10, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Abstract BusinessObject for StromDAO Energy Blockchain. Abstraction layer between blockchain technology and business logic providing ener…☆10Dec 6, 2022Updated 3 years ago
- Next-gen AI memory layer with importance scoring, temporal decay, hierarchical memory, and YMYL prioritization☆48Updated this week
- Bricktronics☆14Aug 20, 2015Updated 11 years ago
- OpenShift CICD Pipeline Library☆13Jul 6, 2022Updated 4 years ago
- Estimation and Prediction of Wet Season Calendar and Soil Water Balance for Agriculture☆16Feb 28, 2025Updated last year
- ☆13Apr 2, 2016Updated 10 years ago
- Easy setup and updating of ReShade on Linux for games using wine or proton.☆16Sep 23, 2025Updated 11 months ago
- A simple PCB adapter for use on a SuperFX or CX4 donor cart☆11Sep 21, 2025Updated 11 months ago
- Host process for loading Switch homebrew NROs☆13Sep 17, 2018Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This is a repository for the Geospatial Data Abstraction Library (GDAL) and it's applications, examples and discussions in the world of s…☆10May 28, 2023Updated 3 years ago
- AI Model Demand Offloading Allocator☆62Updated this week
- Long Long Term Memory Neural Net Cells☆10Jan 25, 2022Updated 4 years ago
- ☆11Apr 7, 2019Updated 7 years ago
- An alternative to Arc Control by Intel®.☆18Jun 16, 2024Updated 2 years ago
- The NowSecure Mobile Security Report☆11Nov 16, 2016Updated 9 years ago
- Try to make my own loader to make SuperCard less suck☆12Feb 8, 2024Updated 2 years ago