TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's TurboQuant (ICLR 2026)
☆93Aug 8, 2026Updated 2 months ago
Alternatives and similar repositories for TurboQuant
Users that are interested in TurboQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆37Aug 19, 2026Updated last month
- ☆14May 27, 2026Updated 4 months ago
- The source code for the paper CrossSinger (asru2023)☆18Oct 12, 2023Updated 2 years ago
- Extract a target speaker’s clean, non-overlapped speech from multi-speaker audio and export word-safe LJSpeech-style TTS datasets.☆23Jun 14, 2026Updated 3 months ago
- LLM inference in C/C++☆2,423Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Jun 23, 2024Updated 2 years ago
- Metal Flash Attention for MLX☆20Oct 1, 2026Updated last week
- 🧠 Bio-Agent OS: 🇻🇳 Bio-Inspired Memory Framework for AI Agents (OpenClaw/ERP). Researched & Developed by Dev Tuan Anh Ha (Locaith Solu…☆20Aug 20, 2026Updated last month
- Mixed-vendor GPU inference cluster manager with speculative decoding☆38Jul 2, 2026Updated 3 months ago
- Embed, cluster, and visualize any collection of texts in 3D semantic space — then learn a continuous semantic flow field over that space,…☆19May 9, 2026Updated 5 months ago
- AI Intelligence Platform -- knowledge graph + semantic search + reasoning + multi-agent debate in a single binary☆21Sep 16, 2026Updated 3 weeks ago
- ☆39Oct 1, 2023Updated 3 years ago
- OverSeek is your open-source command center—a self-hosted, privacy-first platform that unifies analytics, automation, inventory, and cust…☆29Oct 1, 2026Updated last week
- Decensoring Hentai☆13Sep 19, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Updated folk of g2pk☆14Aug 18, 2023Updated 3 years ago
- ☆14Aug 1, 2025Updated last year
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated 3 months ago
- LLM inference in C/C++☆911Updated this week
- Agent Skills for InsForge☆40Aug 29, 2026Updated last month
- Simple inference for Vits2 TTS Using ONNXRUNTIME and espeak-ng on C++☆19Apr 17, 2024Updated 2 years ago
- ☆7,026Jul 20, 2026Updated 2 months ago
- ☆151Jun 13, 2026Updated 3 months ago
- Creating 'deep agents' to encourage LLM's to complete long horizon tasks.☆44Sep 19, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A universal adapter including zero-copy Python bindings for Philip Turner's metal flash attention library.☆29Aug 12, 2026Updated last month
- Python package to download FFmpeg binaries from distro servers☆17Aug 11, 2026Updated last month
- Initial repo for behavioral analyses☆11Aug 24, 2022Updated 4 years ago
- Structured output benchmarks comparing DSPy and BAML with different LLMs☆29Dec 23, 2025Updated 9 months ago
- ☆12Sep 2, 2025Updated last year
- ☆19Feb 2, 2023Updated 3 years ago
- Multilingual-Speech-Synthesis-Voice-Conversion Using Bark + RVC☆14Apr 19, 2025Updated last year
- Server-less, system-less, at-home TTRPG VTT tool to display map images to players in real time, with full control over fog of war, visual…☆17Sep 8, 2026Updated last month
- Clone a voice in 5 seconds to generate arbitrary speech in real-time☆10Aug 1, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI agent toolkit for Compose multiplatform☆15Aug 24, 2026Updated last month
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆412Sep 23, 2026Updated 2 weeks ago
- ☆19Feb 26, 2026Updated 7 months ago
- Hello Github!☆14Jan 8, 2025Updated last year
- The Codebase UI that ships with UCM☆21Oct 2, 2026Updated last week
- burn inference and training of dragon models 🔥🐉☆18Apr 12, 2026Updated 5 months ago
- Simple project to extract glyphs from icon fonts and generate consts for their names and unicode values☆23Feb 4, 2022Updated 4 years ago