tigert1998 / qat
Manually implemented quantization-aware training
☆21Updated 2 years ago
Alternatives and similar repositories for qat
Users that are interested in qat are comparing it to the libraries listed below
Sorting:
- PyTorch Quantization Aware Training Example☆135Updated last year
- BitSplit Post-trining Quantization☆49Updated 3 years ago
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆94Updated 3 years ago
- A Winograd Minimal Filter Implementation in CUDA☆24Updated 3 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆96Updated 3 years ago
- PyTorch implementation of "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"☆55Updated 5 years ago
- ☆204Updated 3 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆92Updated 2 weeks ago
- ☆146Updated 2 years ago
- A Out-of-box PyTorch Scaffold for Neural Network Quantization-Aware-Training (QAT) Research. Website: https://github.com/zhutmost/neuralz…☆26Updated 2 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆35Updated last year
- ☆69Updated 2 years ago
- ☆38Updated 3 years ago
- CUDA Templates for Linear Algebra Subroutines☆99Updated last year
- Code for our paper at ECCV 2020: Post-Training Piecewise Linear Quantization for Deep Neural Networks☆69Updated 3 years ago
- Inference of quantization aware trained networks using TensorRT☆80Updated 2 years ago
- To deploy Transformer models in CV to mobile devices.☆18Updated 3 years ago
- study of Ampere' Sparse Matmul☆18Updated 4 years ago
- pytorch-profiler☆51Updated last year
- play gemm with tvm☆91Updated last year
- Post-training sparsity-aware quantization☆34Updated 2 years ago
- [ICASSP'22] Integer-only Zero-shot Quantization for Efficient Speech Recognition☆31Updated 3 years ago
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆110Updated 5 months ago
- ☆230Updated 2 years ago
- An 8bit automated quantization conversion tool for the pytorch (Post-training quantization based on KL divergence)☆33Updated 5 years ago
- ☆18Updated 4 years ago
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆161Updated 4 years ago
- quantize aware training package for NCNN on pytorch☆70Updated 3 years ago
- ☆36Updated 2 years ago
- The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…☆47Updated 2 years ago