Alternatives and similar repositories for qattn

Users that are interested in qattn are comparing it to the libraries listed below

• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆46Updated last year
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆95Updated 3 years ago
• Qualcomm-AI-research / FP8-quantization
  ☆152Updated 2 years ago
• Qualcomm-AI-research / oscillations-qat
  ☆76Updated 2 years ago
• huqinghao / PalQuant
  ☆12Updated 2 years ago
• hustvl / PD-Quant
  [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metric
  ☆56Updated 2 years ago
• HuangOwen / QAT-ACS
  [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"
  ☆33Updated 10 months ago
• kriskrisliu / NoisyQuant
  An official implement of CVPR 2023 paper - NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers
  ☆21Updated last year
• HuangOwen / Quantization-Variation
  [TMLR] Official PyTorch implementation of paper "Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precisio…
  ☆45Updated 9 months ago
• cjf00000 / StatQuant
  code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"
  ☆28Updated 4 years ago
• Zhen-Dong / BitPack
  BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.
  ☆55Updated 2 years ago
• YanjingLi0202 / Q-ViT
  The official implementation of the NeurIPS 2022 paper Q-ViT.
  ☆96Updated 2 years ago
• nbasyl / OFQ
  The official implementation of the ICML 2023 paper OFQ-ViT
  ☆33Updated last year
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆47Updated 2 years ago
• htqin / BiBench
  [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…
  ☆56Updated last year
• gilshm / sparq
  Post-training sparsity-aware quantization
  ☆34Updated 2 years ago
• IST-DASLab / gemm-fp8
  High Performance FP8 GEMM Kernels for SM89 and later GPUs.
  ☆16Updated 5 months ago
• thu-ml / TetraJet-MXFP4Training
  Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training
  ☆18Updated 3 weeks ago
• jakc4103 / scale-adjusted-training
  PyTorch implementation of Towards Efficient Training for Neural Network Quantization
  ☆15Updated 5 years ago
• aojunzz / NM-sparsity
  ☆237Updated 2 years ago
• ModelTC / mqbench-paper
  ☆44Updated 4 years ago
• DeadAt0m / LSQFakeQuantize-PyTorch
  FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch
  ☆34Updated 3 years ago
• xuke225 / EQ-Net
  EQ-Net [ICCV 2023]
  ☆29Updated last year
• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆34Updated 4 years ago
• yaozhewei / HAP
  ☆43Updated last year
• wimh966 / QDrop
  The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quan…
  ☆122Updated 2 years ago
• moranshkolnik / RobustQuantization
  source code of the paper: Robust Quantization: One Model to Rule Them All
  ☆40Updated 2 years ago
• Intelligent-Computing-Lab-Panda / GPTAQ
  Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)
  ☆51Updated last month
• Adamdad / Samesame
  An Tensorflow.keras implementation of Same, Same But Different - Recovering Neural Network Quantization Error Through Weight Factorizatio…
  ☆10Updated 5 years ago
• papers-submission / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆36Updated 2 years ago