Alternatives and similar repositories for EfficientLLMs

Users that are interested in EfficientLLMs are comparing it to the libraries listed below

• facebookresearch / Ternary_Binary_Transformer
  ACL 2023
  ☆39Updated last year
• yxli2123 / LoSparse
  ☆51Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated last year
• lightmatter-ai / INT-FP-QSim
  Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.
  ☆49Updated last year
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆46Updated last year
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated last year
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆24Updated 3 weeks ago
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆41Updated last year
• hdong920 / GRIFFIN
  ☆37Updated 8 months ago
• mobiusml / low-rank-llama2
  Low-Rank Llama Custom Training
  ☆22Updated last year
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆81Updated 5 months ago
• HuangOwen / RoLoRA
  [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
  ☆36Updated 7 months ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆47Updated 2 years ago
• ScalingIntelligence / CATS
  ☆24Updated 6 months ago
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆16Updated last year
• prateeky2806 / ComPEFT
  ☆25Updated last year
• uw-mad-dash / decoding-speculative-decoding
  ☆12Updated 8 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated last year
• epfml / pam
  ☆15Updated last year
• Qualcomm-AI-research / lr-qat
  ☆36Updated 6 months ago
• fmfi-compbio / admm-pruning
  ☆28Updated 9 months ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆49Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆51Updated 2 years ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆58Updated last month
• IntelLabs / Hardware-Aware-Automated-Machine-Learning
  ☆54Updated 2 weeks ago
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆32Updated last year
• ilur98 / DGQ
  Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM
  ☆14Updated last year
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆66Updated 6 months ago
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆32Updated 2 years ago