SpectralQuant: Calibrated Eigenbasis Rotation and Water-Filled Bit Allocation for KV-Cache Compression
☆204May 15, 2026Updated 5 months ago
Alternatives and similar repositories for spectralquant
Users that are interested in spectralquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Jun 15, 2026Updated 4 months ago
- ☆27Jul 13, 2026Updated 3 months ago
- Sequential Monte Carlo Speculative Decoding☆54Aug 25, 2026Updated last month
- A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 "delta" cache that recovers precision — matching the official …☆545Updated this week
- SutroYaro — Sutro Group research workspace for energy-efficient AI training. Point any coding agent at the repo and it becomes a research…☆17May 29, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,053Apr 23, 2026Updated 6 months ago
- AI-powered usability testing CLI☆22Jun 21, 2026Updated 4 months ago
- ☆16Jul 21, 2026Updated 3 months ago
- REAM: Merging Improves Pruning of Experts in LLMs☆28Apr 16, 2026Updated 6 months ago
- TriAttention — Efficient long reasoning with trigonometric KV cache compression. Enables OpenClaw local deployment on memory-constrained …☆862Aug 4, 2026Updated 2 months ago
- ☆39Sep 6, 2026Updated last month
- Official repository for paper Routing-Free Mixture-of-Experts.☆19Aug 23, 2026Updated 2 months ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,950Updated this week
- Standalone C11 and Metal inference server for EmbeddingGemma 300M☆28Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Oct 9, 2025Updated last year
- Rethinking RL for LLM Reasoning: It's Sparse Policy Selection, Not Capability Learning☆42Aug 2, 2026Updated 2 months ago
- world-model-mcp is a signed audit memory server for AI coding agents, delivered as an MCP tool. Every event Ed25519-signed and Merkle-cha…☆24Sep 15, 2026Updated last month
- Official repository for Parallax (Parameterized Local Linear Attention)☆70Jul 30, 2026Updated 2 months ago
- Parameter-efficient fine-tuning of LLMs using QLoRA — 4-bit quantization, PEFT adapters, W&B experiment tracking☆14Oct 13, 2026Updated last week
- ☆308Apr 5, 2026Updated 6 months ago
- Algorithms for latent compaction☆274Apr 22, 2026Updated 6 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆296Updated this week
- 把 On-Policy Distillation 接到 DSpark。☆19Jun 28, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆16Sep 24, 2026Updated 3 weeks ago
- Triton kernels for dynamic causal short convolutions.☆31Jun 4, 2026Updated 4 months ago
- Deploy an AI chatbot in one click from your terminal☆10Aug 24, 2025Updated last year
- [NeurIPS 2026] When Reasoning Meets Its Laws☆38Jan 2, 2026Updated 9 months ago
- Reproducible llama.cpp configs + per-category quality benches for Qwen3.6-27B on a single RTX 4090. Winners, dead ends, and the silent-co…☆24Apr 26, 2026Updated 5 months ago
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,275Updated this week
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 6 months ago
- LLM inference in C/C++☆15Aug 27, 2026Updated last month
- [ICLR 2026] ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference☆345Aug 19, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,194Aug 18, 2026Updated 2 months ago
- ☆21Jun 12, 2026Updated 4 months ago
- Cross-GPU KV Cache Marketplace☆27Nov 12, 2025Updated 11 months ago
- Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated mod…☆46Jun 7, 2026Updated 4 months ago
- PC-ALM☆243Sep 8, 2026Updated last month
- ☆21Sep 3, 2026Updated last month
- a LLM inference engine to run on consumer hardware☆48Apr 15, 2026Updated 6 months ago