First open-source implementation of Google TurboQuant (ICLR 2026) -- near-optimal KV cache compression for LLM inference. 5x compression with near-zero quality loss.
☆78May 25, 2026Updated 2 months ago
Alternatives and similar repositories for turboquant
Users that are interested in turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Award-winning AI Agent. Recognized as the most ambitious project of 2025 at Kotlin Expert Workshop☆15Mar 22, 2026Updated 4 months ago
- ISP^2 is a plug-and-play prompting method☆12May 25, 2026Updated 2 months ago
- Drop-in prompt-caching fixes for the LLM agent harness you use. Point your AI coding agent at this repo and it ships the patches.☆113Jul 10, 2026Updated last month
- From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% a…☆1,038Apr 23, 2026Updated 3 months ago
- Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free…☆25Aug 4, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Make your OpenClaw AI agent faster, smarter, and cheaper. Speed optimization, memory architecture, context management, model selection, a…☆380Jul 1, 2026Updated last month
- Most desktop customization is hours of config files, forum threads, and broken themes — Hermes flips that on its head by learning your se…☆18May 6, 2026Updated 3 months ago
- Rust implementation of TurboQuant, PolarQuant, and QJL — zero-overhead vector quantization for semantic search and KV cache compression (…☆26May 31, 2026Updated 2 months ago
- AI Agent - It can book rides, order food, post tweets and also control basic tasks on device.☆39Aug 24, 2025Updated 11 months ago
- Hermes port of Karpathy-inspired LLM coding guidelines — SKILL.md + examples.☆24Jun 17, 2026Updated last month
- 🤖 Community fork of Google's Gemini CLI for Qwen AI models. A powerful command-line tool that uses Alibaba Cloud's Qwen models to unders…☆60Jul 5, 2025Updated last year
- OpenHands plugin and skill workflow for durable repository documentation, with optional GitNexus enrichment☆17Jul 27, 2026Updated 2 weeks ago
- KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon☆32Jun 18, 2025Updated last year
- 🧊 Specification for Universal Shading Language (In Progress)☆18May 10, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆37Apr 27, 2026Updated 3 months ago
- ☆17May 16, 2026Updated 2 months ago
- Call commands safely by checking them rigorously against an allow-list☆16Jul 31, 2026Updated 2 weeks ago
- Verified Line-Addressed File Editor☆16Updated this week
- The official GitHub page for the survey paper "Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Arti…☆25Jul 21, 2025Updated last year
- Generic tmux-based workspace manager for multi-repo development. Lightning-fast dev productivity tool.☆19Updated this week
- AI chat application powered by the DeepSeek model (deepseek-r1:7b). It is built using Jetpack Compose with an MVVM design pattern, adheri…☆12Feb 12, 2025Updated last year
- Self-memory and replacement models for Hermes agents. Remember your work. Train your replacement.☆142May 17, 2026Updated 2 months ago
- Workflow-as-code orchestration for Codex☆62Jun 5, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆11Feb 15, 2025Updated last year
- ☆12Nov 21, 2024Updated last year
- Give your agent a knowledge graph that compounds.☆34Jun 15, 2026Updated 2 months ago
- AI-Hybrid Rules Engine for Logical Reasoning.☆17Aug 5, 2026Updated last week
- high-confidence document q+a system for complex docs☆19Jul 30, 2026Updated 2 weeks ago
- AI coder powered by open source LLMs☆11Nov 28, 2024Updated last year
- push_notification_flutter☆10Aug 22, 2022Updated 3 years ago
- AI agent that watches your errors and opens fix PRs☆16May 24, 2026Updated 2 months ago
- A prototype mobile text editor with Language Server Protocol support☆16Mar 19, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- High-performance technical indicators library for financial analysis, optimized with Numba☆19Jul 11, 2026Updated last month
- ☆16Feb 9, 2024Updated 2 years ago
- ubuntu 系统下 GLM-4-Voice 部署经验分享☆18Oct 31, 2024Updated last year
- 🪄 Living documents that update themselves from your conversation — a pi extension☆50Mar 31, 2026Updated 4 months ago
- Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI☆23Updated this week
- Skills for the vibes. My opinionated skills shipping real stuff.☆16Jun 19, 2026Updated last month
- Video object tracking, point tracking, and video question answering using the Qwen3-VL multimodal vision-language model. Supports text-gu…☆15Feb 28, 2026Updated 5 months ago