☆307Apr 5, 2026Updated 7 months ago
Alternatives and similar repositories for turboquant-gpu
Users that are interested in turboquant-gpu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,059Apr 23, 2026Updated 6 months ago
- ☆14Aug 31, 2026Updated 2 months ago
- TriAttention — Efficient long reasoning with trigonometric KV cache compression. Enables OpenClaw local deployment on memory-constrained …☆870Aug 4, 2026Updated 3 months ago
- implementation of a context graph?? we'll see☆11Dec 30, 2025Updated 10 months ago
- Experimental llama.cpp fork for inference research and development☆909Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- HTTP, SOCKS4, SOCKS5 proxies checker with gui style☆51Sep 30, 2026Updated last month
- Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK☆2,783Updated this week
- ALMA (Automated meta-Learning of Memory designs for Agentic systems) is a framework that meta-learns memory designs to replace human-engi…☆302Oct 12, 2026Updated last month
- A calm agent multiplexer with familiar IDE features, for macOS, with an iPhone app.☆97Updated this week
- The first distributed AGI system. Thousands of autonomous AI agents collaboratively train models, share experiments via P2P gossip, and p…☆2,075Oct 17, 2026Updated 3 weeks ago
- Run Qwen3.5-35B-A3B with 1 million token context on a single NVIDIA L4☆29Apr 9, 2026Updated 7 months ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,238Aug 18, 2026Updated 2 months ago
- TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration☆1,818Sep 3, 2026Updated 2 months ago
- DeepSeek-V4-Flash native Blackwell FP8 benchmark on dual DGX Spark GB10 (TP=2, MTP, RoCE). c=1 38.4 t/s, c=16 144.6 t/s aggregate.☆13Jun 16, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Lucebox inference engine for heterogeneous hardware & consumer GPUs☆3,007Updated this week
- Demo code for Gemini Live Integration☆13Jul 29, 2025Updated last year
- LLM inference in C/C++☆2,451Updated this week
- vision-language study material☆10Jun 19, 2025Updated last year
- Lint modeling, modular, and configuration files for structural conventions☆12Updated this week
- Combining Graph-Based Planning and Deep Reinforcement Learning. Masters Thesis. Written in Rust.☆10Apr 8, 2025Updated last year
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,367Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,496Oct 7, 2026Updated last month
- Agent Cage is a Docker-based sandbox prototype that gives AI agents complete access to an Ubuntu environment while experimenting with IT-…☆65Jun 17, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.☆45Aug 16, 2026Updated 3 months ago
- A lightweight inference engine supporting speculative speculative decoding (SSD).☆1,022May 10, 2026Updated 6 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Oct 25, 2026Updated 3 weeks ago
- llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired…☆237Nov 5, 2026Updated last week
- A measurement-first lab for low-latency local camera inference with Glance.☆53Sep 24, 2026Updated last month
- HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code…☆4,362Updated this week
- Build a RAG agent for your codebase (+ websearch-grounded!)☆11Apr 29, 2025Updated last year
- OpenKB: Open LLM Knowledge Base☆4,967Jul 22, 2026Updated 3 months ago
- Agent skill to turn any arxiv paper into a working implementation☆1,544Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Agent memory infrastructure: provenance, rollback, lifecycle/supersession, three-layer model (working memory + session archive + wiki). M…☆291May 8, 2026Updated 6 months ago
- ☆7,027Jul 20, 2026Updated 3 months ago
- [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, a…☆13,797Updated this week
- ☆28Sep 27, 2026Updated last month
- An experiential learning fork of TrueAGI's "minecraft-demo"☆17Aug 21, 2026Updated 2 months ago
- ☆33Nov 7, 2026Updated last week
- Security scanning for AI Agents☆33Mar 28, 2026Updated 7 months ago
Are these results useful?