Open-source implementation of Google's TurboQuant (ICLR 2026) — KV cache compression to 2.5–4 bits with near-zero quality loss. 3.8–5.7x memory reduction on Mistral-7B, no training required.
☆52Mar 29, 2026Updated 5 months ago
Alternatives and similar repositories for turboquant
Users that are interested in turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An open-source zero-human ops platform 🦾🩶☆221Aug 10, 2026Updated 2 weeks ago
- A lightweight transformer language model built from scratch in PyTorch, trained on a single consumer GPU with a full pipeline for data pr…☆42Aug 20, 2026Updated last week
- Jina Embedding Models on AWS SageMaker☆15Jun 4, 2026Updated 2 months ago
- ☆14Dec 1, 2023Updated 2 years ago
- https://github.com/Significant-Gravitas/Catalysts☆16May 13, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆48Apr 5, 2026Updated 4 months ago
- ☆14Jan 31, 2016Updated 10 years ago
- A terminal coding agent, and a Python SDK for embedding on-device models in your own apps.☆50Updated this week
- ☆147Aug 7, 2026Updated 3 weeks ago
- A self-hosted AI toolkit running locally via Docker Compose, bundling an LLM gateway, workflow automation, and a chat UI — all backed by …☆16May 17, 2026Updated 3 months ago
- Mixed-vendor GPU inference cluster manager with speculative decoding☆33Jul 2, 2026Updated last month
- Quickly retrieve all keys and download links of your bundle from IndieGala or Humble Bundle. This is not a hack or anything like that to …☆10Sep 2, 2019Updated 6 years ago
- A fully local, zero-API, zero-finetune multi-agent AI architecture that makes an 8B base model perform high level model reasoning, resear…☆34Nov 25, 2025Updated 9 months ago
- A local-first Windows AI assistant with a multi-model council pipeline, Python sandbox, web search, and cloud AI support. Free. Private. …☆19Aug 15, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Steam Web API for Node.js and io.js☆13Sep 22, 2015Updated 10 years ago
- Convert Sigma Rules to different formats☆15Aug 12, 2024Updated 2 years ago
- Node.js implementation of Steam crypto☆15Apr 11, 2016Updated 10 years ago
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆15Jun 1, 2025Updated last year
- API Jadwal Sholat, Sistem Informasi Jadwal Sholat - Siforlat Backend use node js☆13Oct 25, 2021Updated 4 years ago
- A light PAM module to log user's username and password.☆15Mar 16, 2018Updated 8 years ago
- Official Implementation for NorMuon paper☆86Apr 30, 2026Updated 4 months ago
- Use any AI model, locally or in the cloud, while tracking on-device token usage and collecting token telemetry data.☆18Aug 14, 2026Updated 2 weeks ago
- Perplexity style AI answer engine for AI PCs with CPU,GPU and NPU support☆50Mar 1, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆16Aug 10, 2026Updated 2 weeks ago
- A radically extensible coding agent for the modern Lisp hacker☆28Jul 10, 2026Updated last month
- ☆13Oct 9, 2021Updated 4 years ago
- ☆20Apr 17, 2026Updated 4 months ago
- Safety-first, open-source disk cleaner for Windows 10/11. Reclaim gigabytes of hidden junk — no ads, no telemetry, no registry snake oil.…☆24Jul 17, 2026Updated last month
- 根据应用包名和内容过滤器，接收、拦截并记录Android应用的通知栏消息推送。☆14Jan 16, 2019Updated 7 years ago
- LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.☆399Apr 26, 2026Updated 4 months ago
- Dasein managed vector index service - Python SDK☆23May 11, 2026Updated 3 months ago
- Turn AI coding sessions into reusable engineering memory, evals, briefs, and skills.☆17May 5, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SSH v2 client implementation☆18Jul 14, 2026Updated last month
- A menu bar app for macOS written in SBCL☆22Oct 30, 2025Updated 10 months ago
- Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent …☆89Updated this week
- AI integration into any app for everyday use.☆18Aug 3, 2026Updated 3 weeks ago
- A Java library for accessing NUMA (Non Uniform Memory Access) API☆16Mar 13, 2013Updated 13 years ago
- ☆19Mar 19, 2026Updated 5 months ago
- The Esoteric Insult Language☆25Aug 17, 2017Updated 9 years ago