LOG-postech / rethinking-LLM-pruningLinks
☆28Updated 10 months ago
Alternatives and similar repositories for rethinking-LLM-pruning
Users that are interested in rethinking-LLM-pruning are comparing it to the libraries listed below
Sorting:
- Compressed LLMs for Efficient Text Generation [ICLR'24 Workshop]☆89Updated last year
- Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)☆65Updated last year
- ☆62Updated 2 years ago
- ☆23Updated last year
- [NeurIPS'23] Speculative Decoding with Big Little Decoder☆95Updated last year
- ☆11Updated 5 months ago
- ☆39Updated last year
- Official repository of "Distort, Distract, Decode: Instruction-Tuned Model Can Refine its Response from Noisy Instructions", ICLR 2024 Sp…☆21Updated last year
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆75Updated 6 months ago
- [ICML 2024] Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆38Updated 11 months ago
- ☆53Updated last year
- 🔨 Malet (Machine Learning Experiment Tool) is a tool for efficient machine learning experiment execution, logging, analysis, and plot ma…☆17Updated 8 months ago
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆25Updated 10 months ago
- Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.☆141Updated 5 months ago
- Official implementation for LaCo (EMNLP 2024 Findings)☆21Updated last year
- Explorations into some recent techniques surrounding speculative decoding☆295Updated last year
- Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)☆54Updated 6 months ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆21Updated last year
- Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…☆88Updated 10 months ago
- Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…☆68Updated last year
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆108Updated 2 years ago
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆50Updated last year
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆83Updated last year
- The official code for Dropping Backward Propagation (DropBP)☆31Updated last year
- Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)☆247Updated 9 months ago
- Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference☆47Updated last year
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆50Updated 9 months ago
- ☆38Updated last month
- [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs☆123Updated 6 months ago
- ☆56Updated last year