☆24Mar 7, 2025Updated last year
Alternatives and similar repositories for rethink-kv-compression
Users that are interested in rethink-kv-compression are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models☆16Nov 4, 2025Updated 11 months ago
- A comprehensive and efficient long-context model evaluation framework☆31Aug 31, 2026Updated 2 months ago
- The code for paper "LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models"☆17Mar 2, 2025Updated last year
- A Collection of Parallel Algorithms for Computational Geometry☆12Mar 10, 2022Updated 4 years ago
- code for paper Accurate KV Cache Quantization with Outlier Tokens Tracing (ACL2025 Main)☆11Jul 4, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Feb 15, 2026Updated 8 months ago
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆23Oct 10, 2024Updated 2 years ago
- Source code for paper Fused3S: Fast Sparse Attention on Tensor Cores☆11Oct 13, 2025Updated last year
- Efficient N:M sparsity implementation for GPGPU☆10Oct 31, 2024Updated 2 years ago
- ☆13Nov 5, 2025Updated 11 months ago
- [ACL 2026 (Main)] LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification☆86Jul 14, 2025Updated last year
- ☆17Oct 26, 2026Updated last week
- ☆16Jun 4, 2024Updated 2 years ago
- ☆49Apr 11, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Suri: Multi-constraint instruction following for long-form text generation [EMNLP’24]☆27Oct 3, 2025Updated last year
- Multivariate cumulants of any order☆15May 17, 2023Updated 3 years ago
- ☆20Nov 5, 2024Updated last year
- ☆15Aug 3, 2024Updated 2 years ago
- ☆12Jun 6, 2026Updated 4 months ago
- Multi-Layer Key-Value sharing experiments on Pythia models☆35Jun 14, 2024Updated 2 years ago
- Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''☆32Oct 24, 2024Updated 2 years ago
- InstAttention: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference☆19Mar 30, 2025Updated last year
- KV cache compression via sparse coding☆18Oct 26, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A replication of "Toy Models of Superposition," a groundbreaking machine learning research paper published by authors affiliated with Ant…☆10Dec 30, 2023Updated 2 years ago
- A Postgres extension that rewrites strings to 💩☆21May 14, 2023Updated 3 years ago
- ☆61Dec 19, 2025Updated 10 months ago
- [ACL 2024] Official PyTorch implementation of "IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact"☆46May 24, 2024Updated 2 years ago
- ☆19Jan 13, 2026Updated 9 months ago
- A DeepSeek Harness plugin for AI-driven PCB design in KiCad. A plugin that lets DeepSeek Harness design PCBs with KiCad.☆15Updated this week
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Sep 9, 2026Updated last month
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆287Jul 6, 2025Updated last year
- ☆32May 24, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs☆44Aug 14, 2024Updated 2 years ago
- From Scratch to Submission: A Complete Guide to Academic Conference Paper Writing☆33Sep 26, 2025Updated last year
- 🐙「久美子大冒险」2D像素小游戏☆21Oct 10, 2024Updated 2 years ago
- CHERRL: A Controllable Hacking Environment for Rubric-Based Reinforcement Learning☆16Oct 15, 2026Updated 2 weeks ago
- clustering algorithm implementation☆13Oct 19, 2026Updated 2 weeks ago
- convert GitHub issues to a website☆29Oct 2, 2026Updated last month
- ☆68May 19, 2025Updated last year