aiha-lab / Attention-Head-Pruning

Related projects: ⓘ

• aiha-lab / TernGEMM
  TernGEMM: General Matrix Multiply Library with Ternary Weights for Fast DNN Inference
  ☆13Updated 2 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆186Updated 2 years ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆46Updated last year
• facebookresearch / SpinQuant
  Code repo for the paper "SpinQuant LLM quantization with learned rotations"
  ☆79Updated this week
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆50Updated 6 months ago
• zhexinli / Q-ViT-DeiT
  DeiT implementation for Q-ViT
  ☆23Updated 2 years ago
• luuyin / OWL
  Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
  ☆49Updated 2 months ago
• KwangHoonAn / PACT
  Reproducing Quantization paper PACT
  ☆55Updated 2 years ago
• shawnricecake / EdgeQAT
  Official Repo for EdgeQAT
  ☆12Updated 6 months ago
• kssteven418 / SqueezeLLM-gradients
  ☆14Updated 7 months ago
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆38Updated 11 months ago
• SteveTsui / ReBNN
  ☆13Updated 10 months ago
• WoosukKwon / retraining-free-pruning
  [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
  ☆160Updated last year
• aojunzz / DominoSearch
  ☆18Updated 2 years ago
• facebookresearch / bit
  Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer
  ☆98Updated last year
• kssteven418 / I-BERT
  [ICML'21 Oral] I-BERT: Integer-only BERT Quantization
  ☆220Updated last year
• HuangOwen / QAT-ACS
  Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"
  ☆25Updated last month
• Qualcomm-AI-research / oscillations-qat
  ☆67Updated 2 years ago
• sIncerass / QBERT
  ☆15Updated last year
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆30Updated last year
• DD-DuDa / awesome-vit-quantization-acceleration
  List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.
  ☆47Updated 3 months ago
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆89Updated last week
• Qualcomm-AI-research / outlier-free-transformers
  ☆30Updated 9 months ago
• kriskrisliu / NoisyQuant
  An official implement of CVPR 2023 paper - NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers
  ☆16Updated 6 months ago
• Qualcomm-AI-research / BayesianBits
  ☆20Updated 2 years ago
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆96Updated 2 years ago
• nbasyl / OFQ
  The official implementation of the ICML 2023 paper OFQ-ViT
  ☆27Updated 11 months ago
• zhangsichengsjtu / AFPQ
  AFPQ code implementation
  ☆15Updated 10 months ago
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆84Updated 7 months ago
• HuangOwen / VVTQ
  Official PyTorch implementation of paper "Variation-aware Vision Transformer Quantization"
  ☆33Updated 3 months ago