Open-source implementation of Google's TurboQuant (ICLR 2026) — KV cache compression to 2.5–4 bits with near-zero quality loss. 3.8–5.7x memory reduction on Mistral-7B, no training required.
☆51Mar 29, 2026Updated 7 months ago
Alternatives and similar repositories for turboquant
Users that are interested in turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local AI toolkit for Obsidian. Weekly insights, morning briefings, study recaps and .txt to .md format. Powered by Ollama, runs 100% on y…☆13Mar 28, 2026Updated 7 months ago
- A lightweight transformer language model built from scratch in PyTorch, trained on a single consumer GPU with a full pipeline for data pr…☆42Sep 30, 2026Updated last month
- ☆11Mar 14, 2025Updated last year
- A Startup Speedrun resource — 38+ active grants, funds, and non-dilutive financing for Indian startups. Interactive knowledge graph, Obsi…☆24Apr 23, 2026Updated 6 months ago
- A self-hosted AI toolkit running locally via Docker Compose, bundling an LLM gateway, workflow automation, and a chat UI — all backed by …☆15May 17, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Open-source desktop AI agent that sees what you see — one hotkey over any window, it answers, acts, or guides you step-by-step.☆43Oct 10, 2026Updated 2 weeks ago
- This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention…☆42Oct 11, 2026Updated 2 weeks ago
- Zero downtime embedding upgrades☆55Sep 15, 2026Updated last month
- ☆16Oct 21, 2026Updated last week
- React web app that lets creators generate AI images and 3D models using free services like AI Horde and HuggingFace. Built with Vite and …☆23Dec 17, 2024Updated last year
- A solana Tx Log Parser☆20Apr 27, 2025Updated last year
- A high-performance verifiable storage layer for appchains and L2s.☆13Jan 5, 2026Updated 9 months ago
- Get Random Numbers, Names, Dates and much more.☆12Aug 8, 2020Updated 6 years ago
- A browsable, searchable memory layer for Hermes AI agent conversations — automatically captured, summarized, and injected as context into…☆14May 29, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- See what Xcode has left on disk, and delete what you choose.☆15Oct 8, 2026Updated 3 weeks ago
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- Lightweight, reactive WebGL library for working with shaders☆18Updated this week
- Safely run your agents using any coding harness☆33Updated this week
- 💾 Binary crates cache for @actions-rs/install Action☆15Jan 14, 2021Updated 5 years ago
- A privacy-first, self-hosted AI assistant that plugs directly into your Home Assistant stack, this project turns local LLMs into a practi…☆20Jul 27, 2026Updated 3 months ago
- Mixed-vendor GPU inference cluster manager with speculative decoding☆38Jul 2, 2026Updated 3 months ago
- Visual-first architecture workspace with typed graphs, deterministic validation, semantic diffs, and proposal-gated AI changes.☆16Aug 27, 2026Updated 2 months ago
- A CAT-Q-style ternary quantization trainer for Qwen3, with MLX export for Apple silicon.☆10Sep 8, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Whole-disk file search for Windows: any file by name in a millisecond, search inside your files, a search bar on Alt+Shift+Space and a tr…☆20Oct 18, 2026Updated last week
- ☆11Jul 13, 2022Updated 4 years ago
- Live, interactive, byte-accurate visualizations of how computers actually work — 300+ tested topics across networking, cryptography, dist…☆17Aug 2, 2026Updated 2 months ago
- Code with the complete results of the "How to make Pi more like Claude Code" tutorial☆12Updated this week
- ☆13Jun 27, 2025Updated last year
- Command-line code auditor: fast static checks, plus an optional audit where Claude investigates the code with read-only tools.☆15Oct 13, 2026Updated 2 weeks ago
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆14Jun 1, 2025Updated last year
- 🦙 A cute and cuddly multi-platform cryptocurrency quant trading engine.☆10Jul 21, 2026Updated 3 months ago
- Full pipeline for building LLM, including pretrain, instruction tuning with RLHF, DPO, and distillation☆15Aug 14, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 🍯 An open source interface for the Honey Finance protocol☆30May 24, 2024Updated 2 years ago
- Run software that was never built for your computer.☆16Oct 13, 2026Updated 2 weeks ago
- Windows Hardware Diagnostic & Local AI Model Advisor. Fast in-process hardware detection & intelligent local LLM recommender for Ollama.☆35Sep 1, 2026Updated last month
- An offline coding agent for local models. One command sets up the best model your GPU can run, and on 24 GB+ RTX 30/40/50-series cards Qw…☆129Updated this week
- ☆13Jun 23, 2026Updated 4 months ago
- ☆11Mar 1, 2026Updated 7 months ago
- From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% a…☆1,049Apr 23, 2026Updated 6 months ago