Alternatives and similar repositories for Compressed-Transformers

Users that are interested in Compressed-Transformers are comparing it to the libraries listed below

• kssteven418 / Q-ASR
  [ICASSP'22] Integer-only Zero-shot Quantization for Efficient Speech Recognition
  ☆34Updated 3 years ago
• Jangho-Kim / PSG-pytorch
  Position-based Scaled Gradient for Model Quantization and Pruning Code (NeurIPS 2020)
  ☆26Updated 4 years ago
• houlu369 / Normalized-Quantized-LSTM
  Implementation of NeurIPS 2019 paper "Normalization Helps Training of Quantized LSTM"
  ☆31Updated last year
• 1adrianb / expert-binary-networks
  Code for High-Capacity Expert Binary Networks (ICLR 2021).
  ☆27Updated 3 years ago
• mrusci / training-mixed-precision-quantized-networks
  This repository containts the pytorch scripts to train mixed-precision networks for microcontroller deployment, based on the memory contr…
  ☆50Updated last year
• microsoft / only_train_once
  OTOv1-v3, NeurIPS, ICLR, TMLR, DNN Training, Compression, Structured Pruning, Erasing Operators, CNN, Diffusion, LLM
  ☆46Updated last year
• Andrew-Tierno / QuantizedTransformer
  Implementation of a Quantized Transformer Model
  ☆19Updated 6 years ago
• ModelTC / LPCV2021_Winner_Solution
  ☆28Updated 3 years ago
• gilshm / sparq
  Post-training sparsity-aware quantization
  ☆34Updated 2 years ago
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆33Updated 2 years ago
• Shunli-Wang / Tiny-YOLO-LSQ
  This is an implementation of YOLO using LSQ network quantization method.
  ☆23Updated 3 years ago
• CAS-CLab / Training-Tricks-for-Binarized-Neural-Networks
  The collection of training tricks of binarized neural networks.
  ☆72Updated 4 years ago
• peiswang / BitSplit
  BitSplit Post-trining Quantization
  ☆50Updated 3 years ago
• leimao / PyTorch-Quantization-Aware-Training
  PyTorch Quantization Aware Training Example
  ☆140Updated last year
• 1adrianb / binary-networks-pytorch
  Binarize convolutional neural networks using pytorch
  ☆148Updated 3 years ago
• lswzjuer / pytorch-quantity
  An 8bit automated quantization conversion tool for the pytorch (Post-training quantization based on KL divergence)
  ☆32Updated 5 years ago
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆95Updated 3 years ago
• skmhrk1209 / QuanTorch
  PyTorch implementation of "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆58Updated 6 years ago
• ShuaiZ1037 / bnn-xnor-bireal
  Pytorch implementations of the BNN, XNOR-Net and BiReal-Net
  ☆15Updated 5 years ago
• zhutmost / neuralzip
  A Out-of-box PyTorch Scaffold for Neural Network Quantization-Aware-Training (QAT) Research. Website: https://github.com/zhutmost/neuralz…
  ☆25Updated 2 years ago
• moranshkolnik / RobustQuantization
  source code of the paper: Robust Quantization: One Model to Rule Them All
  ☆40Updated 2 years ago
• yikaiw / SNN
  [ICCV 2021] Code release for "Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks"
  ☆33Updated 3 years ago
• tigert1998 / qat
  Manually implemented quantization-aware training
  ☆21Updated 2 years ago
• WeixiangXu / STTN
  ☆17Updated 2 years ago
• ysbsb / awesome-quantization
  Awesome Quantization Paper lists with Codes
  ☆10Updated 4 years ago
• facebookresearch / bit
  Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer
  ☆111Updated 2 years ago
• kssteven418 / I-BERT
  [ICML'21 Oral] I-BERT: Integer-only BERT Quantization
  ☆258Updated 2 years ago
• buaabai / Ternary-Weights-Network
  Ternay-Weights-Network/Pytorch
  ☆39Updated 7 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆205Updated 3 years ago
• papers-submission / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆36Updated 2 years ago