☆308Apr 5, 2026Updated 6 months ago
Alternatives and similar repositories for turboquant-gpu
Users that are interested in turboquant-gpu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,053Apr 23, 2026Updated 6 months ago
- ☆12Aug 31, 2026Updated last month
- Dynamic per-token early exit for LLM inference. Skip layers tokens don't need☆34Sep 18, 2026Updated last month
- HTTP, SOCKS4, SOCKS5 proxies checker with gui style☆48Sep 30, 2026Updated 3 weeks ago
- implementation of a context graph?? we'll see☆11Dec 30, 2025Updated 9 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Experimental llama.cpp fork for inference research and development☆890Updated this week
- TriAttention — Efficient long reasoning with trigonometric KV cache compression. Enables OpenClaw local deployment on memory-constrained …☆862Aug 4, 2026Updated 2 months ago
- turboquant-based compression engine for LLM KV cache☆61Apr 3, 2026Updated 6 months ago
- ☆32Oct 7, 2026Updated 2 weeks ago
- Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK☆2,635Oct 16, 2026Updated last week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,194Aug 18, 2026Updated 2 months ago
- ☆23Oct 14, 2026Updated last week
- The first distributed AGI system. Thousands of autonomous AI agents collaboratively train models, share experiments via P2P gossip, and p…☆2,072Updated this week
- Run Qwen3.5-35B-A3B with 1 million token context on a single NVIDIA L4☆29Apr 9, 2026Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ALMA (Automated meta-Learning of Memory designs for Agentic systems) is a framework that meta-learns memory designs to replace human-engi…☆296Oct 12, 2026Updated last week
- A measurement-first lab for low-latency local camera inference with Glance.☆52Sep 24, 2026Updated 3 weeks ago
- A calm agent multiplexer with familiar IDE features, for macOS, with an iPhone app.☆90Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,950Updated this week
- Tile the latent, not the pixels: native ComfyUI nodes for latent-native tiled NVIDIA PiD decoding. Seam-free masters up to 244MP, 56 rend…☆18Aug 28, 2026Updated last month
- LLM inference in C/C++☆2,437Updated this week
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Updated this week
- OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis☆1,263Jun 10, 2026Updated 4 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,155Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration☆1,802Sep 3, 2026Updated last month
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,414Oct 7, 2026Updated 2 weeks ago
- ☆16Sep 8, 2026Updated last month
- Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.☆45Aug 16, 2026Updated 2 months ago
- Persistent project knowledge graph for coding agents. MCP server with semantic search, in-process embeddings, and web explorer.☆726May 3, 2026Updated 5 months ago
- Agentic test batteries for local models via Hermes Agent - scripted tools + real Hermes CLI sessions☆15Aug 14, 2026Updated 2 months ago
- A tiny voice-action model, built to run on any device.☆96Oct 8, 2026Updated 2 weeks ago
- ☆19Apr 17, 2026Updated 6 months ago
- A lightweight inference engine supporting speculative speculative decoding (SSD).☆1,020May 10, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- OpenKB: Open LLM Knowledge Base☆4,804Jul 22, 2026Updated 3 months ago
- llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired…☆233Oct 13, 2026Updated last week
- Spiking around on RemoteGraph functionality in LangGraph☆12Apr 24, 2026Updated 5 months ago
- Agent memory infrastructure: provenance, rollback, lifecycle/supersession, three-layer model (working memory + session archive + wiki). M…☆291May 8, 2026Updated 5 months ago
- Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards☆232Sep 1, 2026Updated last month
- ☆27Updated this week
- 🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.☆2,365Updated this week