KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44x fewer params. Drop-in llama.cpp integration.
☆1,027Apr 23, 2026Updated 2 months ago
Alternatives and similar repositories for rotorquant
Users that are interested in rotorquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML2026] From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priors☆92Apr 30, 2026Updated 2 months ago
- [ICCV 2025] Inpaint4Drag: Repurposing Inpainting Models for Drag-Based Image Editing via Bidirectional Warping☆94Nov 30, 2025Updated 7 months ago
- LLM inference in C/C++☆63May 7, 2026Updated 2 months ago
- LLM inference in C/C++☆2,097Updated this week
- Source code to accompany research paper on training multi token prediction language models using self-distillation.☆39Feb 21, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆12Sep 16, 2017Updated 8 years ago
- Official Implementation of "Colored Noise Diffusion Sampling"☆38Jun 1, 2026Updated last month
- ☆17Mar 13, 2026Updated 4 months ago
- The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamics☆70Mar 26, 2026Updated 3 months ago
- [CVPR 2026] Scaling Zero-Shot Reference-to-Video Generation☆76Apr 28, 2026Updated 2 months ago
- Official repository of paper "ProEdit: Inversion-based Editing From Prompts Done Right"☆116Feb 5, 2026Updated 5 months ago
- ☆54Jul 18, 2024Updated last year
- Control 3D Generation with Explicit Geometry☆97Jun 22, 2026Updated 3 weeks ago
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆387May 29, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [Official Repo] SpatialEdit: Benchmarking Fine-Grained Image Spatial Editing☆212Apr 13, 2026Updated 3 months ago
- ROSA+: RWKV's ROSA implementation with fallback statistical predictor☆36Oct 13, 2025Updated 9 months ago
- An inference-time, plug-and-play method for temporal control in multi-event generation☆184Apr 26, 2026Updated 2 months ago
- Implementation of <Streaming Autoregressive Video Generation via Diagonal Distillation> in ICLR 2026☆129Mar 18, 2026Updated 3 months ago
- A lightweight Inference Engine built for block diffusion models☆47Apr 12, 2026Updated 3 months ago
- ☆33Mar 14, 2026Updated 4 months ago
- ☆6,992Jun 26, 2026Updated 2 weeks ago
- LLAMA Turboquant implementation with CUDA support☆687Updated this week
- ☆25Jul 2, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [SIGGRAPH 2026] AniGen: Unified S^3 Fields for Animatable 3D Asset Generation☆443Updated this week
- Official PyTorch implementation of "GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance" (ICML 2025)☆53Apr 13, 2026Updated 3 months ago
- Transforming Video Diffusion with Temporal Sparse Attention☆54Apr 8, 2026Updated 3 months ago
- [ICML 2026] Official implementation for "DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion".☆356May 18, 2026Updated last month
- First public benchmark of llama.cpp speculative decoding on Qwen3.6-35B-A3B with a single RTX 3090 (post PR #19493 merge, 2026-04-19). 19…☆31May 16, 2026Updated last month
- [ICML 2026] Flash-GRPO: Efficient Alignment for Video Diffusion via One-Step Policy Optimization☆55Jun 11, 2026Updated last month
- ☆21Jun 4, 2024Updated 2 years ago
- ☆48Mar 29, 2026Updated 3 months ago
- Quartet II Official Code☆75May 1, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implements harmful/harmless refusal removal using pure HF Transformers☆21May 8, 2025Updated last year
- [ICML 2026] DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generation☆272May 22, 2026Updated last month
- Llama.cpp launcher with integrated huggingface☆59Jun 25, 2026Updated 2 weeks ago
- [CoLM 24] Official Repository of MambaByte: Token-free Selective State Space Model☆27Oct 12, 2024Updated last year
- Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild☆224Jun 23, 2026Updated 3 weeks ago
- Get up and running with Kimi-K2.5, GLM-4.7, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆37May 17, 2026Updated last month
- ☆90May 13, 2026Updated 2 months ago