Zefan-Cai / KVCache-FactoryLinks
Unified KV Cache Compression Methods for Auto-Regressive Models
☆1,275Updated 10 months ago
Alternatives and similar repositories for KVCache-Factory
Users that are interested in KVCache-Factory are comparing it to the libraries listed below
Sorting:
- [Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models☆1,145Updated 3 weeks ago
- ☆915Updated this week
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆259Updated 2 months ago
- SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model（1.7B, 4B, 8B, 30B）☆280Updated 3 weeks ago
- [NIPS'25 Spotlight] Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,224Updated last month
- adds Sequence Parallelism into LLaMA-Factory☆588Updated last month
- [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"☆554Updated 3 months ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆138Updated 7 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆260Updated 7 months ago
- An acceleration library that supports arbitrary bit-width combinatorial quantization operations☆236Updated last year
- UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g…☆957Updated this week
- [NeurIPS 2025🔥]Main source code of SRPO framework.☆180Updated last month
- [Arxiv] Discrete Diffusion in Large Language and Multimodal Models: A Survey☆333Updated 2 weeks ago
- ☆322Updated 2 months ago
- A scalable, end-to-end training pipeline for general-purpose agents☆361Updated 4 months ago
- A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.☆476Updated this week
- [ICML2025] Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment☆132Updated this week
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆289Updated 2 months ago
- [ICLR 2025] BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments☆38Updated 8 months ago
- ☆125Updated last month
- ☆46Updated 7 months ago
- Awesome-Efficient-Inference-for-LRMs is a collection of state-of-the-art, novel, exciting, token-efficient methods for Large Reasoning Mo…☆233Updated 5 months ago
- A highly optimized LLM inference acceleration engine for Llama and its variants.☆903Updated 4 months ago
- [COLM’25] DeepRetrieval — 🔥 The First Search Agent Trained by On-Policy Reinforcement Learning☆666Updated last month
- An adaptive sampling framework for Reinforce-style LLM post training.☆81Updated 2 weeks ago
- (ICCV-2025 Official Code)) Improving Generalist Model with Domain-Specific Experts☆85Updated 2 weeks ago
- The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models☆713Updated 2 weeks ago
- [NeurIPS'24] Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy☆72Updated 9 months ago
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆267Updated 6 months ago
- ScaleCUA is the open-sourced computer use agents that can operate on corss-platform environments (Windows, macOS, Ubuntu, Android).☆793Updated last month