TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's TurboQuant (ICLR 2026)
☆91Aug 8, 2026Updated this week
Alternatives and similar repositories for TurboQuant
Users that are interested in TurboQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆37Apr 27, 2026Updated 3 months ago
- The source code for the paper CrossSinger (asru2023)☆18Oct 12, 2023Updated 2 years ago
- Unified KV-cache compression for LLM inference: 12 Python-native methods, Debian-tested isolated add-ons, Godzilla KVarN/TriAttention, ex…☆25Aug 3, 2026Updated last week
- Extract a target speaker’s clean, non-overlapped speech from multi-speaker audio and export word-safe LJSpeech-style TTS datasets.☆22Jun 14, 2026Updated last month
- TurboQuant llama.cpp fork with optimized turbo4 kernels for Gemma 4 D=256/512 heads — lazy K/V, batch decode, warp-cooperative write. 120…☆35Apr 5, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LLM inference in C/C++☆2,250Updated this week
- Build AI agents using the same architecture patterns as Claude Code. Skill + 6 examples + runnable Python code. No framework.☆23Apr 3, 2026Updated 4 months ago
- ☆15Jun 23, 2024Updated 2 years ago
- “A locally hosted, memory-aware AI microservice—designed for cultural continuity, decentralized intelligence, and ethical autonomy.”☆27May 1, 2025Updated last year
- 🧠 Bio-Agent OS: 🇻🇳 Bio-Inspired Memory Framework for AI Agents (OpenClaw/ERP). Researched & Developed by Dev Tuan Anh Ha (Locaith Solu…☆20Updated this week
- ☆39Oct 1, 2023Updated 2 years ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆50May 20, 2025Updated last year
- Updated folk of g2pk☆13Aug 18, 2023Updated 2 years ago
- ☆14Aug 1, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated last month
- Rust implementation of TurboQuant, PolarQuant, and QJL — zero-overhead vector quantization for semantic search and KV cache compression (…☆26May 31, 2026Updated 2 months ago
- Bitbeam is a LEGO Technic-compatible system for building robots and other contraptions. You can make Bitbeam with 3D printers, CNC mills,…☆23Apr 18, 2014Updated 12 years ago
- A universal adapter including zero-copy Python bindings for Philip Turner's metal flash attention library.☆29Jul 20, 2026Updated 3 weeks ago
- A collection of real-world machine learning web applications built with ML.NET, ASP.NET Core, Azure Cosmos DB, and React, which can be us…☆11Jan 25, 2021Updated 5 years ago
- Initial repo for behavioral analyses☆11Aug 24, 2022Updated 3 years ago
- Wokwi-example how the display is initialised for different boards☆12Mar 13, 2023Updated 3 years ago
- Convert Korean to Katakana☆13Dec 13, 2023Updated 2 years ago
- Revolutionary Runtime CSS Generator for Blazor☆14Apr 3, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆19Feb 2, 2023Updated 3 years ago
- Repository containing ULX3S blink LED binaries☆14May 16, 2022Updated 4 years ago
- VALL-E 한국어 버전☆12Aug 22, 2023Updated 2 years ago
- Multilingual-Speech-Synthesis-Voice-Conversion Using Bark + RVC☆14Apr 19, 2025Updated last year
- 대학교 동아리를 위한 그룹웨어☆11May 28, 2021Updated 5 years ago
- Server-less, system-less, at-home TTRPG VTT tool to display map images to players in real time, with full control over fog of war, visual…☆16Jul 5, 2026Updated last month
- ☆27Jul 19, 2026Updated 3 weeks ago
- ☆26Feb 10, 2026Updated 6 months ago
- An OpenAI-compatible API proxy for chat.z.ai. Drop it in front of any OpenAI-compatible tool and start using Z.AI's GLM models without br…☆49Aug 3, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AI-powered tool that generates YouTube-style thumbnails from a title using image generation and Cloudinary transformations.☆19Mar 25, 2026Updated 4 months ago
- The Codebase UI that ships with UCM☆21May 20, 2026Updated 2 months ago
- Gne의 확장 언어입니다☆12Aug 24, 2024Updated last year
- Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on t…☆25May 8, 2026Updated 3 months ago
- ✨Realtime Voice Changer with 3~ seconds for custom voice in CPU☆21Apr 21, 2026Updated 3 months ago
- High-performance ASR tool using Faster Whisper, supporting custom models, multi-language transcription, and real-time processing feedback…☆10Sep 17, 2025Updated 10 months ago
- Asynchronous client for the Tidal API☆14Aug 31, 2025Updated 11 months ago