TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's TurboQuant (ICLR 2026)
☆93Aug 8, 2026Updated last month
Alternatives and similar repositories for TurboQuant
Users that are interested in TurboQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆41Mar 31, 2026Updated 5 months ago
- ☆14May 27, 2026Updated 3 months ago
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆26Aug 22, 2026Updated 3 weeks ago
- Extract a target speaker’s clean, non-overlapped speech from multi-speaker audio and export word-safe LJSpeech-style TTS datasets.☆23Jun 14, 2026Updated 3 months ago
- LLM inference in C/C++☆35Aug 24, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LLM inference in C/C++☆2,386Updated this week
- ☆15Jun 23, 2024Updated 2 years ago
- “A locally hosted, memory-aware AI microservice—designed for cultural continuity, decentralized intelligence, and ethical autonomy.”☆27May 1, 2025Updated last year
- NEXO runtime core for NEXO Desktop: local memory, automation, MCP tools and update-managed runtime.☆27Jul 3, 2026Updated 2 months ago
- ☆14Updated this week
- Metal Flash Attention for MLX☆20Aug 3, 2026Updated last month
- 🧠 Bio-Agent OS: 🇻🇳 Bio-Inspired Memory Framework for AI Agents (OpenClaw/ERP). Researched & Developed by Dev Tuan Anh Ha (Locaith Solu…☆20Aug 20, 2026Updated last month
- AI Intelligence Platform -- knowledge graph + semantic search + reasoning + multi-agent debate in a single binary☆21Updated this week
- Generate visual overlays from your i3 bindings☆14Aug 22, 2020Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆39Oct 1, 2023Updated 2 years ago
- Comfyui custom node for FunAudioLLM include CosyVoice2, SenseVoice and InspireMusic☆15Jan 9, 2026Updated 8 months ago
- ☆13Mar 20, 2018Updated 8 years ago
- 2D Character Creator Example☆11Dec 2, 2019Updated 6 years ago
- Сервер с пустым миром на который можно зайти с поддержкой плагинов. (Python 3)☆13Mar 7, 2018Updated 8 years ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆50May 20, 2025Updated last year
- CORS Policy with dynamic resolver allowing origins configured at the startup as well as others based on the implementation of the method.…☆12Nov 9, 2020Updated 5 years ago
- Updated folk of g2pk☆14Aug 18, 2023Updated 3 years ago
- PolarEngine: vLLM plugin for PolarQuant quantized LLM inference — 75% FP16 speed at 2.3x less VRAM☆36Apr 13, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Aug 1, 2025Updated last year
- ☆12Oct 4, 2021Updated 4 years ago
- Rust implementation of TurboQuant, PolarQuant, and QJL — zero-overhead vector quantization for semantic search and KV cache compression (…☆26Aug 20, 2026Updated last month
- Simple inference for Vits2 TTS Using ONNXRUNTIME and espeak-ng on C++☆19Apr 17, 2024Updated 2 years ago
- ☆7,030Jul 20, 2026Updated 2 months ago
- Fully automated memory and context management for Claude Code using hooks - Zero friction, zero context loss☆34Oct 22, 2025Updated 10 months ago
- A collection of SPI related cores☆23Nov 12, 2024Updated last year
- ☆154Jun 13, 2026Updated 3 months ago
- Creating 'deep agents' to encourage LLM's to complete long horizon tasks.☆44Sep 19, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Comfy EverAnimate WIP☆17Jun 5, 2026Updated 3 months ago
- Open-source AI agent orchestration platform — self-hosted mission control for autonomous multi-agent systems. Visual DAG workflows, 670+ …☆69Updated this week
- Wokwi-example how the display is initialised for different boards☆12Mar 13, 2023Updated 3 years ago
- Structured output benchmarks comparing DSPy and BAML with different LLMs☆29Dec 23, 2025Updated 8 months ago
- ☆12Sep 2, 2025Updated last year
- Convert Korean to Katakana☆13Dec 13, 2023Updated 2 years ago
- ☆19Feb 2, 2023Updated 3 years ago