SpectralQuant: Calibrated Eigenbasis Rotation and Water-Filled Bit Allocation for KV-Cache Compression
☆203May 15, 2026Updated 4 months ago
Alternatives and similar repositories for spectralquant
Users that are interested in spectralquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sequential Monte Carlo Speculative Decoding☆53Aug 25, 2026Updated last month
- turboquant-based compression engine for LLM KV cache☆61Apr 3, 2026Updated 6 months ago
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,052Apr 23, 2026Updated 5 months ago
- Triton kernels for dynamic causal short convolutions.☆30Jun 4, 2026Updated 3 months ago
- NanoGPT speedrun in JAX. Originally at https://nor-git.pages.dev/modded-nanogpt-jax/☆17Aug 28, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- world-model-mcp is a signed audit memory server for AI coding agents, delivered as an MCP tool. Every event Ed25519-signed and Merkle-cha…☆22Sep 15, 2026Updated 2 weeks ago
- Official repository for Parallax (Parameterized Local Linear Attention)☆69Jul 30, 2026Updated 2 months ago
- ☆307Apr 5, 2026Updated 5 months ago
- Triton kernels and PyTorch ops for Block Attention Residuals (AttnRes)☆89May 29, 2026Updated 4 months ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,887Updated this week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,189Updated this week
- ☆13Jun 29, 2024Updated 2 years ago
- Algorithms for latent compaction☆270Apr 22, 2026Updated 5 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆286Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Delta Attention Residuals - supplementary code and pretrained models☆43Sep 26, 2026Updated last week
- ☆45Mar 9, 2026Updated 6 months ago
- Experimental llama.cpp fork for inference research and development☆879Updated this week
- [ICLR 2026] ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference☆341Aug 19, 2026Updated last month
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 5 months ago
- ☆21Jun 12, 2026Updated 3 months ago
- Jax-based non-linear reconciliation and learning☆17Jun 25, 2026Updated 3 months ago
- a LLM inference engine to run on consumer hardware☆48Apr 15, 2026Updated 5 months ago
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A demo showcasing Vapi AI into Nextjs apps. A car rental website built with Next.js (App Router), Vercel Postgres, Tailwind CSS, Shadcn U…☆14Jul 14, 2024Updated 2 years ago
- The Geometric OptimizAtion Libraries☆20Mar 12, 2025Updated last year
- ☆150Sep 4, 2026Updated 3 weeks ago
- ☆35Nov 11, 2025Updated 10 months ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,131Aug 18, 2026Updated last month
- Scripts for managing Debian and RPM package repositories☆18Jan 14, 2026Updated 8 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆1,266Sep 1, 2026Updated last month
- Surgical GPU kernel benchmark: 7 hard problems, frontier coding agents, roofline-graded against hardware peak.☆19Jun 12, 2026Updated 3 months ago
- ☆17Jun 15, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆32May 12, 2026Updated 4 months ago
- Using modal.com to process FineWeb-edu data☆21Sep 12, 2026Updated 3 weeks ago
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆34Updated this week
- ☆20Apr 9, 2026Updated 5 months ago
- Code for the papers: “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling” and “Adaptive Block-Scaled Data Types”☆204Apr 21, 2026Updated 5 months ago
- ☆101Updated this week
- MarkdownLM CLI tool for knowledge base operations☆20Feb 24, 2026Updated 7 months ago