Algorithms for latent compaction
☆267Apr 22, 2026Updated 4 months ago
Alternatives and similar repositories for compaction
Users that are interested in compaction are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Storing long contexts in tiny caches with self-study☆324Mar 23, 2026Updated 5 months ago
- SR²AM: Efficient Agentic Reasoning Through Self-Regulated Simulative Planning☆21May 22, 2026Updated 3 months ago
- LLM KV cache compression made easy☆1,209Updated this week
- Triton kernels for dynamic causal short convolutions.☆29Jun 4, 2026Updated 3 months ago
- [COLM-LLA 2026] The official implementation for paper "AdaExplore: Failure-Driven Adaptation and Diversity-Preserving Search for Efficien…☆24Aug 23, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TriAttention — Efficient long reasoning with trigonometric KV cache compression. Enables OpenClaw local deployment on memory-constrained …☆849Aug 4, 2026Updated last month
- [ACL Findings 2026] Official Implementation of "FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acc…☆33Apr 14, 2026Updated 4 months ago
- ☆17Jun 15, 2026Updated 2 months ago
- ☆16May 27, 2026Updated 3 months ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆28May 12, 2026Updated 4 months ago
- ☆287Jun 6, 2025Updated last year
- [TrimKV] Cache What Lasts: Token Retention for Memory-Bounded KV Cache in LLMs - [DBTrimKV] Make Each Token Count: Towards Improving Lo…☆21Jul 26, 2026Updated last month
- [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)☆225Feb 11, 2026Updated 7 months ago
- Fused KL divergence from hidden states for knowledge distillation☆22Apr 28, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆24Jan 25, 2026Updated 7 months ago
- ☆483Nov 25, 2025Updated 9 months ago
- A codebase for pretraining multi-billion-scale sparse GPTs.☆30Feb 9, 2026Updated 7 months ago
- SpectralQuant: Calibrated Eigenbasis Rotation and Water-Filled Bit Allocation for KV-Cache Compression☆202May 15, 2026Updated 3 months ago
- CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs☆250Updated this week
- Official JAX implementation of End-to-End Test-Time Training for Long Context☆700Feb 15, 2026Updated 6 months ago
- Official codebase for AdaRank: Adaptive Rank Pruning for Enhanced Model Merging (ICLR 2026)☆20Jan 26, 2026Updated 7 months ago
- ☆35Nov 11, 2025Updated 10 months ago
- DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation☆311Feb 18, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆30Oct 2, 2025Updated 11 months ago
- Official implementation of Paper "System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving"☆30Apr 17, 2026Updated 4 months ago
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆52May 30, 2026Updated 3 months ago
- ☆86Aug 19, 2026Updated 3 weeks ago
- Pytorch code for paper QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models☆25Sep 27, 2023Updated 2 years ago
- Data generation and training repository for SERA: Soft-Verified Efficient Repository Agents.☆155May 25, 2026Updated 3 months ago
- ☆138Feb 4, 2026Updated 7 months ago
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆28Sep 2, 2025Updated last year
- ☆42Mar 28, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- The Official Implementation of Ada-KV [NeurIPS 2025]☆139Nov 26, 2025Updated 9 months ago
- AFPQ code implementation☆23Nov 6, 2023Updated 2 years ago
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆344Nov 11, 2025Updated 10 months ago
- ☆27Jul 13, 2026Updated 2 months ago
- Fork of Flame repo for training of some new stuff in development☆20Aug 27, 2026Updated 2 weeks ago
- Code for the papers: “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling” and “Adaptive Block-Scaled Data Types”☆204Apr 21, 2026Updated 4 months ago
- Fast low-bit matmul kernels in Triton☆484Aug 9, 2026Updated last month