Open-source implementation of Google's TurboQuant (ICLR 2026) — KV cache compression to 2.5–4 bits with near-zero quality loss. 3.8–5.7x memory reduction on Mistral-7B, no training required.
☆51Mar 29, 2026Updated 6 months ago
Alternatives and similar repositories for turboquant
Users that are interested in turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Jina Embedding Models on AWS SageMaker☆15Jun 4, 2026Updated 4 months ago
- An open-source zero-human ops platform 🦾🩶☆284Updated this week
- A terminal coding agent, and a Python SDK for embedding on-device models in your own apps.☆51Aug 26, 2026Updated last month
- ☆149Sep 16, 2026Updated 3 weeks ago
- Mixed-vendor GPU inference cluster manager with speculative decoding☆37Jul 2, 2026Updated 3 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Much more Lispy(tm) Tcl/Tk 9.0☆16May 19, 2026Updated 4 months ago
- A local-first Windows AI assistant with a multi-model council pipeline, Python sandbox, web search, and cloud AI support. Free. Private. …☆28Oct 1, 2026Updated last week
- autoresearch for everything — autonomous iterative improvement for any system☆39Apr 2, 2026Updated 6 months ago
- Official Implementation for NorMuon paper☆94Apr 30, 2026Updated 5 months ago
- Use any AI model, locally or in the cloud, while tracking on-device token usage and collecting token telemetry data.☆18Aug 14, 2026Updated last month
- Perplexity style AI answer engine for AI PCs with CPU,GPU and NPU support☆51Mar 1, 2026Updated 7 months ago
- From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% a…☆1,048Apr 23, 2026Updated 5 months ago
- TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration☆1,793Sep 3, 2026Updated last month
- ☆11Nov 30, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Aug 10, 2026Updated 2 months ago
- Receive payment anonymously from anyone.☆11Feb 9, 2025Updated last year
- A radically extensible coding agent for the modern Lisp hacker☆45Jul 10, 2026Updated 2 months ago
- 🌍 source code for the randomsounds.wtf website☆11Sep 6, 2025Updated last year
- Safety-first, open-source disk cleaner for Windows 10/11. Reclaim gigabytes of hidden junk — no ads, no telemetry, no registry snake oil.…☆28Sep 4, 2026Updated last month
- LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.☆403Apr 26, 2026Updated 5 months ago
- https://genzmafia.github.io/communityguide☆10Jan 20, 2021Updated 5 years ago
- Conduits for the Spark Protocol.☆13Jun 6, 2025Updated last year
- SSH v2 client implementation☆19Jul 14, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Dasein managed vector index service - Python SDK☆23May 11, 2026Updated 4 months ago
- A menu bar app for macOS written in SBCL☆22Oct 30, 2025Updated 11 months ago
- Turn AI coding sessions into reusable engineering memory, evals, briefs, and skills.☆17May 5, 2026Updated 5 months ago
- Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent …☆108Updated this week
- here we go again...☆15Nov 9, 2022Updated 3 years ago
- deployment scripts for full nodes for RPC endpoint provision☆10Feb 13, 2024Updated 2 years ago
- ☆16Apr 24, 2024Updated 2 years ago
- ☆19Mar 19, 2026Updated 6 months ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An AI-powered coding assistant plugin for the Eclipse IDE.☆17Oct 28, 2025Updated 11 months ago
- ☆17Feb 3, 2024Updated 2 years ago
- Predicting emotions on Android☆12Nov 26, 2020Updated 5 years ago
- An efficient spiking variational autoencoder☆13Nov 13, 2023Updated 2 years ago
- [ICML'26] PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation☆228Sep 6, 2026Updated last month
- A website having collection of javascript programs and questions.☆13Jan 6, 2023Updated 3 years ago
- Conduit — native SwiftUI iOS client for Hermes Agent☆233Updated this week