SalesforceAIResearch / ThinKLinks
ThinK: Thinner Key Cache by Query-Driven Pruning
☆26Updated 10 months ago
Alternatives and similar repositories for ThinK
Users that are interested in ThinK are comparing it to the libraries listed below
Sorting:
- A Sober Look at Language Model Reasoning☆92Updated last month
- [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models☆21Updated last year
- ☆23Updated last year
- LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification☆69Updated 5 months ago
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆25Updated 5 months ago
- ☆49Updated last year
- ☆142Updated last year
- [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆197Updated last month
- ☆71Updated 8 months ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆36Updated last year
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆85Updated 6 months ago
- [ICLR‘24 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆102Updated 6 months ago
- ☆77Updated last year
- ☆39Updated last year
- ☆53Updated last year
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆61Updated 10 months ago
- Codes for Merging Large Language Models☆34Updated last year
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆47Updated 8 months ago
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆66Updated 9 months ago
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆113Updated last year
- [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models☆64Updated last year
- ☆19Updated 7 months ago
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆25Updated 10 months ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆88Updated 10 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆94Updated 2 months ago
- [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".☆23Updated 9 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆224Updated last year
- RL with Experience Replay☆51Updated 5 months ago
- ☆18Updated last year
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆52Updated last year