horseee / LLaMA-Pruning
Structural Pruning for LLaMA
☆54Updated last year
Alternatives and similar repositories for LLaMA-Pruning:
Users that are interested in LLaMA-Pruning are comparing it to the libraries listed below
- PB-LLM: Partially Binarized Large Language Models☆151Updated last year
- Reorder-based post-training quantization for large language model☆188Updated last year
- Unofficial implementations of block/layer-wise pruning methods for LLMs.☆67Updated 11 months ago
- Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆81Updated 5 months ago
- QuIP quantization☆51Updated last year
- ☆147Updated last year
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆63Updated 6 months ago
- Work in progress.☆56Updated 2 weeks ago
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆47Updated last year
- ☆50Updated last year
- An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆35Updated 10 months ago
- Low-bit optimizers for PyTorch☆128Updated last year
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization☆129Updated 2 months ago
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆41Updated 2 years ago
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆121Updated 3 months ago
- Repository for CPU Kernel Generation for LLM Inference☆26Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆97Updated 6 months ago
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆111Updated last year
- FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation☆48Updated 9 months ago
- ☆125Updated last year
- Are gradient information useful for pruning of LLMs?☆43Updated last year
- [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.☆23Updated this week
- Low-Rank Llama Custom Training☆22Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆40Updated last year
- [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models☆48Updated last year
- [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization☆36Updated 7 months ago
- ☆122Updated 2 months ago
- Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆36Updated 2 months ago
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆87Updated 11 months ago
- ☆26Updated 9 months ago