Open-source implementation of Google's TurboQuant (ICLR 2026) — KV cache compression to 2.5–4 bits with near-zero quality loss. 3.8–5.7x memory reduction on Mistral-7B, no training required.
☆52Mar 29, 2026Updated 5 months ago
Alternatives and similar repositories for turboquant
Users that are interested in turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Policy Iteration for Continuous Dynamics☆22May 21, 2026Updated 3 months ago
- Open-Source Intelligent Command Layer☆106Updated this week
- https://github.com/Significant-Gravitas/Catalysts☆16May 13, 2023Updated 3 years ago
- A terminal coding agent, and a Python SDK for embedding on-device models in your own apps.☆50Aug 26, 2026Updated 3 weeks ago
- ☆148Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- React web app that lets creators generate AI images and 3D models using free services like AI Horde and HuggingFace. Built with Vite and …☆23Dec 17, 2024Updated last year
- QJL: 1-Bit Quantized JL transform for KV Cache Quantization with Zero Overhead☆99Jan 27, 2025Updated last year
- Quickly retrieve all keys and download links of your bundle from IndieGala or Humble Bundle. This is not a hack or anything like that to …☆10Sep 2, 2019Updated 7 years ago
- A fully local, zero-API, zero-finetune multi-agent AI architecture that makes an 8B base model perform high level model reasoning, resear…☆35Nov 25, 2025Updated 9 months ago
- Much more Lispy(tm) Tcl/Tk 9.0☆16May 19, 2026Updated 4 months ago
- A local-first Windows AI assistant with a multi-model council pipeline, Python sandbox, web search, and cloud AI support. Free. Private. …☆26Updated this week
- Steam Web API for Node.js and io.js☆13Sep 22, 2015Updated 10 years ago
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆15Jun 1, 2025Updated last year
- autoresearch for everything — autonomous iterative improvement for any system☆38Apr 2, 2026Updated 5 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- API Jadwal Sholat, Sistem Informasi Jadwal Sholat - Siforlat Backend use node js☆13Oct 25, 2021Updated 4 years ago
- Abandoned, unsupported research archive for a local-first, model-agnostic LLM agent harness exploring orchestration, code retrieval, off-…☆23Sep 6, 2026Updated 2 weeks ago
- Highly secure second factor auth by screaming at your computer.☆18Dec 28, 2019Updated 6 years ago
- Perplexity style AI answer engine for AI PCs with CPU,GPU and NPU support☆51Mar 1, 2026Updated 6 months ago
- From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% a…☆1,046Apr 23, 2026Updated 4 months ago
- TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration☆1,777Sep 3, 2026Updated 2 weeks ago
- ☆16Aug 10, 2026Updated last month
- ☆18Jun 6, 2026Updated 3 months ago
- A radically extensible coding agent for the modern Lisp hacker☆40Jul 10, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 根据应用包名和内容过滤器，接收、拦截并记录Android应用的通知栏消息推送。☆14Jan 16, 2019Updated 7 years ago
- LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.☆402Apr 26, 2026Updated 4 months ago
- Repo-local continuity runtime for AI coding agents. Helps them continue from the same inspectable work state instead of starting cold. St…☆58Jun 17, 2026Updated 3 months ago
- Course materials for an onboarding to GraphQL program☆13Nov 20, 2020Updated 5 years ago
- SSH v2 client implementation☆19Jul 14, 2026Updated 2 months ago
- A menu bar app for macOS written in SBCL☆22Oct 30, 2025Updated 10 months ago
- Frontend interface for Developer DAO - Devs for Revolution NFT collection.☆14May 21, 2022Updated 4 years ago
- Example of using Next.JS with JS-IPFS☆10May 1, 2025Updated last year
- CLAMM V1 & V2☆11Apr 1, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated 2 years ago
- An AI-powered coding assistant plugin for the Eclipse IDE.☆14Oct 28, 2025Updated 10 months ago
- ☆17Feb 3, 2024Updated 2 years ago
- A plugin for Tauri that provides a polyfill for Gamepad Web API that works on most common platforms.☆15May 18, 2026Updated 4 months ago
- Preregistered Jacobian-lens reliability research on Gemma 4: 25k prompts, frozen probes, public traces, a prospective transfer miss, and …☆53Sep 11, 2026Updated last week
- A website having collection of javascript programs and questions.☆13Jan 6, 2023Updated 3 years ago
- steam account generator for jacking old hotmail emails☆13Jun 8, 2017Updated 9 years ago