kssteven418 / I-BERT
[ICML'21 Oral] I-BERT: Integer-only BERT Quantization
☆244Updated 2 years ago
Alternatives and similar repositories for I-BERT:
Users that are interested in I-BERT are comparing it to the libraries listed below
- ☆203Updated 3 years ago
- This repository contains integer operators on GPUs for PyTorch.☆204Updated last year
- ☆230Updated 2 years ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆432Updated last year
- ☆145Updated 2 years ago
- Low Precision Arithmetic Simulation in PyTorch☆276Updated 11 months ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆189Updated 2 years ago
- Unofficial implementation of LSQ-Net, a neural network quantization framework☆291Updated last year
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆118Updated last year
- Pytorch implementation of BRECQ, ICLR 2021☆272Updated 3 years ago
- PyTorch implementation for the APoT quantization (ICLR 2020)☆272Updated 4 months ago
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆221Updated 3 weeks ago
- ☆55Updated last year
- Post-Training Quantization for Vision transformers.☆216Updated 2 years ago
- The PyTorch implementation of Learned Step size Quantization (LSQ) in ICLR2020 (unofficial)☆132Updated 4 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆96Updated 3 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆333Updated 9 months ago
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆278Updated last year
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆109Updated 5 months ago
- Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer☆106Updated last year
- A library for researching neural networks compression and acceleration methods.☆139Updated 8 months ago
- This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.☆88Updated last year
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆262Updated last year
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆161Updated 4 years ago
- [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer☆337Updated 2 years ago
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆383Updated 4 years ago
- Quantization of Convolutional Neural networks.☆244Updated 9 months ago
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆268Updated 2 months ago
- ☆97Updated last year
- Research and development for optimizing transformers☆126Updated 4 years ago