horseee / LLaMA-PruningLinks
Structural Pruning for LLaMA
☆54Updated 2 years ago
Alternatives and similar repositories for LLaMA-Pruning
Users that are interested in LLaMA-Pruning are comparing it to the libraries listed below
Sorting:
- PB-LLM: Partially Binarized Large Language Models☆152Updated last year
- Reorder-based post-training quantization for large language model☆190Updated 2 years ago
- Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆82Updated 6 months ago
- ☆151Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆97Updated 8 months ago
- FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation☆48Updated 10 months ago
- Unofficial implementations of block/layer-wise pruning methods for LLMs.☆69Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆26Updated last year
- QuIP quantization☆52Updated last year
- Low-Rank Llama Custom Training☆23Updated last year
- ACL 2023☆39Updated last year
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆121Updated 4 months ago
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆40Updated 2 years ago
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated last year
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆65Updated last year
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆48Updated last year
- Low-bit optimizers for PyTorch☆128Updated last year
- [ICML'24 Oral] The official code of "DiJiang: Efficient Large Language Models through Compact Kernelization", a novel DCT-based linear at…☆101Updated 11 months ago
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆68Updated 7 months ago
- ☆56Updated last year
- ☆125Updated last year
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization☆136Updated 2 weeks ago
- An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆35Updated 11 months ago
- Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆37Updated 4 months ago
- [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.☆24Updated last month
- ☆28Updated 10 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆60Updated last year
- Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"☆28Updated last year
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆161Updated 11 months ago