ThinK: Thinner Key Cache by Query-Driven Pruning
☆30Jun 2, 2026Updated 5 months ago
Alternatives and similar repositories for ThinK
Users that are interested in ThinK are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [COLM 2026] An efficient 3D sampling method for long-CoT LLM.☆16May 25, 2025Updated last year
- Make reasoning models scalable☆51Jun 2, 2026Updated 5 months ago
- [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models☆22May 28, 2024Updated 2 years ago
- [ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.☆58May 2, 2025Updated last year
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A list of awesome papers on compression and acceleration of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs).☆18May 12, 2026Updated 5 months ago
- VidKV: Plug-and-Play 1.x-Bit KV Cache Quantization for Video Large Language Models☆25Mar 26, 2025Updated last year
- ☆31Apr 14, 2025Updated last year
- PrefixKV: Adaptive Prefix KV Cache is What Vision Instruction-Following Models Need for Efficient Generation [NeurIPS 2025]☆20Oct 11, 2025Updated last year
- Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition☆21Apr 16, 2025Updated last year
- UP-TO-DATE LLM Adaptive thinking paper. 🔥🔥🔥☆15Jul 31, 2025Updated last year
- ☆11May 28, 2024Updated 2 years ago
- ☆14Sep 7, 2024Updated 2 years ago
- The MATH training dataset without MATH-500 test portion☆16Dec 20, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The official repository for QWHA☆13Sep 17, 2025Updated last year
- Official repository for paper "Can Language Models Follow Multiple Turns of Entangled Instructions?"☆13Sep 20, 2025Updated last year
- The official code implementation for paper "PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs"☆33May 24, 2025Updated last year
- ☆15Apr 11, 2024Updated 2 years ago
- ☆10Feb 1, 2022Updated 4 years ago
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆124May 24, 2024Updated 2 years ago
- ☆11May 15, 2020Updated 6 years ago
- [ICCV 2025] SparseMM: Head Sparsity Emerges from Visual Concept Responses in MLLMs☆90Jan 17, 2026Updated 9 months ago
- Unofficial implementations of block/layer-wise pruning methods for LLMs.☆78Apr 29, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- codebase for Coruscant: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference☆11Oct 17, 2025Updated last year
- The Official Implementation of Ada-KV [NeurIPS 2025]☆143Nov 26, 2025Updated 11 months ago
- PyTorch implementation for DESC - BMVC20 (Oral) & IJCV22☆17Dec 23, 2022Updated 3 years ago
- A living literature repository for Token Economics for LLM Agents: A Dual-View Study from Computing and Economics.☆42May 13, 2026Updated 5 months ago
- Bookstore, the final project of Course: Contemporary Database Management System @ DaSE, ECNU, having approximately 50,000 Throughput.☆10Dec 6, 2021Updated 4 years ago
- [ACL Findings 2026] Official Implementation of "FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acc…☆34Apr 14, 2026Updated 6 months ago
- Official implementation of "PatchAlign3D: Local Feature Alignment for Dense 3D Shape Understanding"☆23Jan 7, 2026Updated 9 months ago
- ☆14May 29, 2026Updated 5 months ago
- ☆43Jun 8, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Pytorch implementation of TPAMI 2022 -- 1xN Pattern for Pruning Convolutional Neural Networks☆42Sep 14, 2022Updated 4 years ago
- An implementation of SCOPE: Saliency-Coverage Oriented Token Pruning for Efficient Multimodel LLMs (NeurIPS 2025)☆34Oct 31, 2025Updated last year
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆73Sep 18, 2025Updated last year
- [USENIX ATC'25] GeneralSparse: Bridging the Gap in SpMM for Pruned Large Language Model Inference on GPUs☆14Feb 4, 2026Updated 8 months ago
- CFG-GAN: Composite functional gradient learning of generative adversarial models☆15Jul 9, 2020Updated 6 years ago
- ☆15Jan 14, 2026Updated 9 months ago
- [CoRL 2026] Official Codebase for "Native Memory Compression for Long-Horizon Robotic Manipulation"☆17Oct 19, 2026Updated 2 weeks ago