Alternatives and similar repositories for edge-qat:

Users that are interested in edge-qat are comparing it to the libraries listed below

• yxli2123 / LoSparse
  ☆50Updated last year
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆47Updated last year
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆64Updated last year
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆27Updated last year
• ruikangliu / IntactKV
  Official PyTorch implementation of "IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact"
  ☆43Updated 10 months ago
• abdelfattah-lab / TokenButler
  ☆20Updated last week
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆53Updated 2 weeks ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆49Updated 2 years ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆46Updated last year
• VILA-Lab / GBLM-Pruner
  Are gradient information useful for pruning of LLMs?
  ☆43Updated 11 months ago
• HuangOwen / RoLoRA
  [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
  ☆33Updated 6 months ago
• yifanycc / loretta
  [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
  ☆32Updated 3 months ago
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆83Updated 4 months ago
• SempraETY / Pruning-via-Merging
  ☆18Updated 4 months ago
• sramshetty / mixture-of-depths
  An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆35Updated 10 months ago
• DavidFanzz / SCMoE
  ☆21Updated 10 months ago
• hdong920 / LESS
  ☆50Updated 11 months ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆37Updated 10 months ago
• Intelligent-Computing-Lab-Yale / TesseraQ
  ☆19Updated 5 months ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆47Updated 2 years ago
• ruikangliu / Quantized-Reasoning-Models
  Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"
  ☆19Updated last week
• Qualcomm-AI-research / lr-qat
  ☆36Updated 5 months ago
• yangyifei729 / LaCo
  Official implementation for LaCo (EMNLP 2024 Findings)
  ☆16Updated 6 months ago
• ClubieDong / QAQ-KVCacheQuantization
  QAQ: Quality Adaptive Quantization for LLM KV Cache
  ☆49Updated last year
• AkideLiu / MiniCache
  ☆8Updated 7 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆57Updated 6 months ago
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆19Updated last year
• MrGGLS / BlockPruner
  A block pruning framework for LLMs.
  ☆22Updated 9 months ago
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆36Updated 2 months ago
• sramshetty / ShortGPT
  Unofficial implementations of block/layer-wise pruning methods for LLMs.
  ☆68Updated 11 months ago